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Dear  Mike, 

I  would  like  to  summarize  our  research  progress  during  the  period  of  October  1,  1997  through 
September  30,  1998.  The  project,  titled  “Practical  control  algorithms  for  nonlinear  dynami¬ 
cal  systems  using  phase-space  knowledge  and  mixed  numeric  and  geometric  computation” ,  is 
funded  under  the  ONR  YI  Award  (grant  No.  N00014-97-1-0599).  Our  goal  is  to  develop  high- 
performance  computational  tools  for  designing  control  systems  for  a  class  of  complex  physical 
systems. 

•  Developed  a  verification  algorithm  for  verifying  control  laws  using  phase-space  geometric 
modeling  of  dynamical  systems.  The  algorithm  evolves  a  hierarchically-refined  bound  of 
system  nonlinear  dynamics  and  can  address  practical  concerns  such  as  sensor,  actuator, 
and  modeling  uncertainties  in  a  systematic  manner.  We  have  applied  the  algorithm 
to  the  maglev  control  system  prototype  and  compared  the  results  against  the  physical 
measurements. 

•  Constructed  a  physical  experiment  to  study  distributed  acoustic  sensing.  The  experiment 
comprises  an  enclosed  chamber  measured  1.7m  x  0.846m  x  0.201m,  and  an  8-channel 
A/D  and  D/A  system  with  6  microphones  and  a  speaker. 

•  Started  to  investigate  control  system  design  and  optimization  for  distributed  parameter 
physical  systems  (systems  modeled  by  partial  differential  equations) . 

•  Will  present  the  control  verification  paper  at  the  IFAC  International  Symposium  on  Ar¬ 
tificial  Intelligence  in  Real-Time  Control,  Grand  Canyon,  AZ  in  October.  Have  presented 
an  invited  tutorial  at  AAAI  National  Conference  in  Madison,  Wisconsin,  July  1998. 

-  Jeff  May  and  Feng  Zhao,  “Verification  of  control  laws  using  phase-space  geometric 
modeling  of  dynamical  systems.”  IFAC  AIRTC-98. 

-  Feng  Zhao  and  Chris  Bailey-Kellogg,  “Intelligent  Simulation.”  AAAI-98  Tutorial 
Forum. 

I  have  enclosed  copies  of  the  above  mentioned  articles.  Please  do  not  hesitate  to  contact  me  if 


you  need  additional  information. 


Best  Regards, 


Feng  Zhao 
Associate  Professor 
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Abstract:  This  paper  presents  an  algorithm  for  verifying  control  laws  using 
phase-space  geometric  modeling  of  dynamical  systems.  The  algorithm  evolves  a 
hierarchically-refined  bound  of  system  nonlinear  dynamics  and  can  address  practical 
concerns  such  as  sensor,  actuator,  and  modeling  uncertainties  in  a  systematic  manner. 
The  algorithm  has  been  applied  to  verifying  a  control  law  for  a  magnetic  levitation 
system,  and  the  computational  results  are  compared  against  the  performance  of  the 
actual  physical  system. 


Keywords:  Control  systems,  Verification,  Phase  space,  Geometric  approaches, 
Computational  methods. 


1.  INTRODUCTION 

Control  verification  ensures  correct  behaviors  for 
controlled  physical  systems.  Important  applica¬ 
tions  range  from  safety-critical  systems  such  as 
aircraft  controllers,  where  improper  behavior  can 
result  in  loss  of  life,  to  cost-critical  systems  such 
as  factory  controllers,  where  a  faulty  controller 
can  result  in  costly  inefficiency.  Unfortunately, 
obtaining  a  closed-form  analytic  solution  to  the 
verification  problem  is  often  impractical.  The  non¬ 
linear  nature  of  many  man-made  systems  requires 
that  approximations  be  made  to  apply  most  verifi¬ 
cation  techniques.  Uncertainties  such  as  modeling 
and  sensing  error  make  it  difficult  to  express  the 
range  of  possible  behaviors  of  the  system  in  a 
tractable  form.  Thus,  verifying  a  controlled  sys¬ 
tem  frequently  requires  that  linear  approxima¬ 
tions  be  made,  and  that  considerations  for  factors 


such  as  modeling  error  and  sensing  error  be  omit¬ 
ted. 

This  paper  describes  a  computational  verification 
algorithm  that  relies  on  evolving  phase-space  ge¬ 
ometric  models  of  system  dynamics.  The  contri¬ 
butions  of  this  paper  are  threefold:  (1)  It  intro¬ 
duces  a  novel  hierarchical  refinement  of  bounds 
on  system  dynamics  to  avoid  unnecessary  over¬ 
approximation  of  nonlinear  behavior;  (2)  The 
phase-space  representation  it  uses  can  model  non¬ 
linearity  and  uncertainty  in  a  systematic,  intuitive 
manner;  (3)  The  algorithm  has  been  applied  to 
verify  a  nonlinear  maglev  control  system  proto¬ 
typed  in  our  laboratory.  Although  the  phase  space 
of  the  example  used  in  the  paper  is  two  dimen¬ 
sional,  the  algorithm  is  applicable  to  higher-order 
control  systems  as  well  as  those  whose  dynamics 
does  not  admit  a  closed-form  analytic  description 
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but  whose  states  can  be  fully  observed  via  exper¬ 
imental  means. 

A  number  of  approaches  to  verification  exist  for 
simple  linear  systems.  Recent  work  has  focused 
on  developing  methodology  for  more  complex  sys¬ 
tems  such  as  hybrid  systems  (see  e.g.  (Alur  et 
al. ,  1996;  Bouajjani  et  al ,  1993)).  The  approaches 
in  (Henzinger  et  al ,  1995;  Puri  et  al. ,  1996;  Green- 
street  and  Mitchell,  1998;  Dang  and  Maler,  1998) 
use  a  polygonal  or  grid-based  representation  for 
phase-space  regions  of  a  hybrid  system  during 
verification,  and  share  several  similar  concepts 
with  the  algorithm  presented  here.  Our  algorithm 
evolves  from  earlier  work  in  phase-space  con¬ 
trol  synthesis  (Bradley  and  Zhao,  1993;  Zhao  et 
al,  1997). 


2.  PHASE-SPACE  VERIFICATION 
ALGORITHM 

The  phase-space  verification  algorithm  is  used  to 
verify  proper  regions  of  operation  that  have  the 
desired  limit  behaviors  for  stabilization  control 
systems  (i.e.  control  systems  that  are  designed 
to  stabilize  the  plant  in  a  goal  region).  Other 
properties  such  as  overshoot  or  convergence  rate 
can  also  be  verified  with  only  minor  changes  to 
the  algorithm.  The  algorithm  is  applicable  to 
discrete-time  control  systems  with  a  fixed  sam¬ 
pling  frequency.  The  underlying  dynamics  of  the 
plant  may  be  continuous,  discrete,  or  hybrid.  It 
is  assumed  that  the  system  is  designed  to  oper¬ 
ate  within  a  bounded  region  of  the  phase  space. 
Let  the  system  dynamics  be  described  by:  x  = 
F(x,  «),  where  x  is  the  system  state,  and  u  is  the 
control  input.  Since  the  system  is  discretely  sam¬ 
pled,  the  dynamics  of  the  controlled  system  can 
be  written  as  xn+\  =  f(xn),  where  X{  denotes  the 
system  state  at  time  ti  and  f(xi)  =  f  F(zi,o(xi )) 
after  one  time  period  (o(a^)  is  the  controller  out¬ 
put  at  Xi). 

The  algorithm  proceeds  as  follows: 

(1)  Partition  the  phase-space  region  of  interest 
into  a  finite  set  of  cells  C . 

(2)  Determine  the  initial  controllable  region  Rcont 

(3)  For  each  cell  c  in  C  -  RCOnt , 

(a)  Find  a  polytope  pc  bounding  the  image 
of  c  under  /. 

(b)  Compute  the  “escape  polytope”  ec  = 

pc-c. 

(c)  If  ec  is  contained  within  Rcont,  and  / 
generates  no  cycles  within  c,  mark  c  as 
verified,  and  set  Rcont  —  Rcont  U  c. 

(4)  If  any  new  cells  were  added  to  RCOnt  in.  step 
3,  repeat  step  3. 

(5)  If  the  region  of  interest  has  been  verified,  or 
if  a  pre-specified  number  of  steps  has  been 


taken,  quit.  Otherwise,  form  a  new  set  C" 
by  subdividing  the  unmarked  cells  in  C.  Set 
C  =  Cl,  and  go  to  step  3. 

The  partitioning  of  the  phase  space  in  step  1  is  ar¬ 
bitrary;  however,  regular  partitions  are  often  used, 
and  certain  types  of  control  suggest  preferred  par¬ 
titions.  For  example,  control  based  on  cell  maps 
suggests  an  initial  partition  identical  to  the  one 
used  to  generate  the  cell  maps  (Hsu,  1987). 

Determination  of  the  initial  controllable  region 
requires  a  bit  more  effort.  There  are  two  basic 
approaches.  If  the  controller  has  already  been 
verified  for  a  certain  region  Ri  (e.g.  using  ana¬ 
lytic  techniques),  and  the  verification  algorithm 
is  being  used  to  extend  that  region,  RCOnt  is  set 
to  i?i,  and  all  cells  that  are  fully  contained  within 
Ri  are  marked.  This  approach  is  taken,  for  ex¬ 
ample,  when  a  local  controller  (e.g.  one  based  on 
linear  techniques)  is  being  augmented  by  a  global 
controller. 

If  no  “pre-verified”  region  is  available,  RCOnt  can¬ 
not  just  be  set  to  the  goal  region,  because  it  is 
possible  that  for  the  given  controller,  the  plant 
can  start  out  in  the  goal  region,  but  later  exit  it 
and  never  return.  Thus,  in  this  approach,  a  set 
Rcont  of  “core  cells”  must  be  found.  The  “core 
cells”  have  the  following  two  properties: 

(1)  Every  c  G  RCOnt  is  in  the  goal  region. 

(2)  For  every  c  G  Rcont,  the  image  of  c  under  / 
is  contained  in  RCOnt • 

A  maximal  set  of  core  cells  (for  a  given  phase  space 
partition)  can  be  generated  by  selecting  all  cells 
contained  in  the  goal  region,  and  then  iteratively 
eliminating  cells  whose  image  bound  lies  outside 
the  set  of  selected  cells. 

Finding  a  polytope  pc  bounding  /(c)  can  be 
achieved  in  many  ways.  One  of  the  simplest  and 
most  efficient  ways  to  find  a  suitable  pc  is  to 
compute  the  minimum  and  maximum  values  for 
each  component  of  F  over  the  cell  c  and  form 
a  bounding  box  for  /(c)  using  these  values.  In 
hybrid  systems  terms  (see  e.g.  (Branicky,  1995)), 
each  cell  can  be  thought  of  as  a  discrete  state, 
and  the  bounding  polytope  is  determined  by  ap¬ 
proximating  system  dynamics  with  a  rectangular 
differential  inclusion. 

In  step  3,  we  are  checking  for  two  properties: 

(1)  VxGc:  fn(x)  ^  c  for  some  n  G  N.  That  is, 
all  trajectories  of  the  system  starting  within 
c  eventually  exit  c. 

(2)  Vz  G  c,n  G  N  :  fn{x)  £  c  A  fn~i(x)  G  c  =» 
fn(x)  G  Rcont •  That  is,  when  a  trajectory 
exits  c,  it  reaches  a  cell  that  has  already  been 
marked  as  verified. 
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Checking  the  second  property  is  straightforward. 
To  check  the  first  property  we  intersect  f(c)  with 
c  to  form  a  polytope  p'c.  This  process  is  repeated 
with  plc  until  the  intersection  is  empty,  or  a  pre¬ 
specified  number  of  iterations,  i,  is  exceeded. 
Thus,  we  replace  the  first  property  with  a  stronger 
condition — that  all  trajectories  leave  c  within  i 
time  steps. 

Assuming  that  a  regular,  rectangular  initial  par¬ 
tition  is  used,  and  that  subdivision  is  done  uni¬ 
formly,  the  space  requirement  of  the  algorithm  is 
0({2d)sn)  where  d  is  the  dimension  of  the  phase 
space,  s  is  the  level  of  subdivision,  and  n  is  the 
number  of  cells  in  the  initial  partition.  Thus,  the 
memory  requirements  depend  linearly  on  the  size 
of  the  initial  partition,  and  exponentially  on  the 
level  of  subdivision. 

Step  1  typically  has  time  complexity  linear  in  n, 
although  a  complex  partition  may  require  more 
time.  Step  2  requires  at  most  0(n2)  time  if  a  core 
set  is  being  determined.  Each  iteration  of  step  3 
takes  0(n)  time  (for  the  comparison  with  RCOnt in 
3c),  so  the  entire  algorithm  requires  0(((2rf)5n)3). 
As  with  the  space  complexity,  the  time  complex¬ 
ity  has  an  exponential  dependence  on  the  level 
of  subdivision,  and  a  polynomial  dependence  on 
the  size  of  the  initial  partition.  With  a  regular 
partition,  the  comparison  in  step  3c  depends  only 
on  the  cells  intersected  by  the  image  bound,  which 
is  typically  far  less  than  n.  Similarly,  the  order  of 
selection  in  step  3  can  have  a  large  impact  on  the 
efficiency  of  the  algorithm.  In  practice,  the  veri¬ 
fication  of  a  cell  far  from  the  initial  controllable 
region  depends  on  the  verification  of  cells  nearer 
the  region.  An  intelligent  ordering,  that  starts 
from  the  cells  nearest  the  controllable  region  and 
works  outward,  often  results  in  more  cells  being 
verified  for  each  iteration  of  step  3,  thus  reducing 
the  number  of  times  step  3  must  be  iterated  to  a 
number  far  less  than  n. 


2.1  Proof  of  Soundness 

In  this  section,  it  is  shown  that  if  the  system  starts 
in  a  cell  that  has  been  marked  as  verified,  the 
system  will  eventually  progress  to  a  state  within 
the  goal  region. 

Proof:  Number  the  cells  of  the  phase  space  par¬ 
tition  in  the  order  that  they  are  marked,  with 
all  initially  verified  cells  (or  core  cells)  numbered 
zero.  Consider  cell  number  z,  with  i  >  0.  Since 
the  cells  are  numbered  by  order  of  marking,  all 
trajectories  starting  in  cell  i  eventually  flow  into 
a  lower  numbered  cell  (since  cell  i  will  be  marked 
only  if  its  image  bound  lies  in  cells  that  have 
already  been  marked).  Thus,  by  induction,  all  tra¬ 
jectories  starting  in  a  cell  with  a  positive  number 


will  eventually  flow  into  a  cell  numbered  zero.  By 
assumption  (or  by  the  definition  of  core  cell),  no 
trajectories  starting  from  a  zero  numbered  cell  will 
leave  the  set  of  zero  numbered  cells,  so  all  trajec¬ 
tories  will  eventually  progress  to  a  state  within 
the  goal  region. 

Note  that  this  only  guarantees  that  marked  cells 
exhibit  proper  behavior — there  is  no  guarantee 
that  all  cells  that  exhibit  proper  behavior  will 
be  marked  (i.e.  the  algorithm  is  sound  but  not 
necessarily  complete). 


2.2  Enhancements  and  Optimizations 

In  the  above  description,  several  practical  issues, 
such  as  measurement  error,  controller  output  er¬ 
ror,  and  modeling  error  are  not  mentioned.  How¬ 
ever,  because  of  the  geometric  nature  of  the  com¬ 
putation,  such  considerations  can  be  incorporated 
in  a  straightforward  fashion.  Measurement  error 
can  be  accounted  for  by  expanding  the  cell  when 
the  bounding  polytope  is  determined.  Controller 
output  error  and  model  error  can  be  dealt  with 
(assuming  the  error  is  bounded)  by  expanding  the 
image  bounding  polytope  corresponding  to  the 
potential  range  of  the  function  /  describing  the 
dynamics. 

Continuous  time  systems  can  be  verified  by  select¬ 
ing  a  time  period,  and  examining  the  evolution  of 
the  system  over  this  time  period  (i.e.  treating  the 
system  as  a  discretely-sampled  system,  and  using 
the  base  verification  algorithm).  If  necessary,  this 
time  period  can  be  iteratively  reduced  to  provide 
a  less  conservative  bound  on  system  behavior  (as 
is  done  with  the  phase-space  partition  in  the  base 
algorithm) . 

Certain  other  properties  of  a  system  can  be  ver¬ 
ified  with  minor  modifications  to  the  base  algo¬ 
rithm.  For  example,  suppose  it  is  necessary  to 
verify  not  only  that  the  system  reaches  the  goal 
region,  but  also  that  the  percent  overshoot  is 
limited.  In  this  case,  when  a  cell  is  being  checked, 
its  image  bound  must  fall  within  marked  cells  and 
each  of  these  intersected  cells  must  be  annotated 
as  having  trajectories  with  a  tolerable  maximum 
distance  to  the  goal  region.  The  newly  marked  cell 
is  then  annotated  with  its  maximum  distance  as 
well  (computed  as  the  maximum  of  the  annotated 
values  of  the  intersected  cells  and  the  distance  of 
the  cell  itself). 

In  the  base  algorithm,  only  the  behavior  after  one 
sampling  period  is  considered.  This  is  because  the 
bounding  polytope  of  the  image  of  a  cell  increases 
in  size  exponentially  with  time,  thus  making  the 
bound  less  accurate  the  longer  the  time  period 
considered.  However,  when  the  system  dynamics 
are  “slow”  in  comparison  to  the  partition  gran- 


Cell  Boundary 


Image  Boundary 


Fig.  1.  Slow  dynamics  with  respect  to  the  partition 
granularity  and  the  sampling  period  results  in 
dependence  on  an  adjacent  cell. 


Fig.  2.  “Spiraling”  trajectories  in  phase  space. 
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Fig.  3.  Cyclic  dependence  between  cells  created  by 
spiral  trajectories  above. 


Fig.  4.  Sequence  of  images  with  decreasing  unveri¬ 
fied  area.  The  shaded  area  represents  the  pre¬ 
vious  verified  region.  The  transparent  boxes 
represent  a  sequence  of  image  bounds  ( b  is 
the  image  bound  of  a,  c  is  the  image  bound 
of  b  -  Rcont,  et  cetera). 

ularity  and  the  sampling  period,  a  cell’s  image 
bound  will  often  overlap  with  a  neighbor,  resulting 
in  a  dependence  from  the  cell  to  its  neighbor 
(Since  the  neighbor  must  be  verified  before  the  cell 
in  consideration  can  be;  see  figure  1).  If  the  system 
has  “spiraling”  trajectories  (figure  2),  a  cycle  of 
dependence  (figure  3)  between  a  set  of  unverified 
cells  can  occur.  In  this  case,  the  partition  must 
be  subdivided  several  times  to  properly  verify  the 
system.  This  subdivision  is  costly — both  memory 
usage  and  computation  time  scale  exponentially 
with  the  level  of  subdivision  in  the  worst  case.  In 
these  cases,  the  algorithm  can  be  optimized  by 
continuing  to  iterate  the  function  /  when  doing 
so  is  beneficial.  If  the  escape  polytope  ec  does 


Fig.  5.  Diagram  of  magnetic  levitation  system. 

not  lie  entirely  within  verified  cells,  the  polytope 
is  clipped  against  those  unverified  cells  it  inter¬ 
sects,  and  the  resulting  poly  topes  are  recursively 
checked.  This  process  continues  until  either  the 
cell  is  verified  (i.e.  the  iteration  produces  an  im¬ 
age  Bound  that  is  contained  within  the  verified 
region),  or  no  further  “progress”  is  made.  The 
current  implementation  considers  “progress”  to 
Be  made  as  long  as  the  unverified  area  (volume) 
occupied  By  the  Bounding  polytope  is  decreasing 
in  size  (see  figure  4).  Other  criteria  may  also  Be 
useful. 

Algorithmically,  this  optimization  replaces  steps 
3a  -  c  with  a  call  to  the  following  function  on  cell 
c: 

Bool  CheckRegion(region  r) 

(1)  Find  a  polytope  pr  Bounding  the  image  of  r 
under  /. 

(2)  Compute  the  “escape  polytope”  er  gp  r  -r, 

(3)  Set 

r unverified  g  6  r  Rcont' 

(4)  If  r unverified  g  0  return  true. 

(5)  Otherwise,  if  volume(runVerified)  <  volume(r ), 
return  CheckRegion(runverifiect),  else  return 
false. 


3.  RESULTS  AND  ANALYSIS 

The  verification  procedure  has  Been  tested  on 
the  controller  for  a  magnetic  levitation  system 
(figures  5  and  6).  This  system  is  a  useful  testBed 
since  it  is  inherently  unstaBle  and  nonlinear  (due 
to  the  inverse  square  law  of  magnetic  attraction) . 

The  initial  verifiaBle  region  is  oBtained  using 
a  local  controller,  generated  using  a  linearized 
model  of  the  original  nonlinear  system.  This  linear 
controller  is  augmented  By  a  nonlinear,  phase 
space  Based  gloBal  controller  (as  in  (Loh,  1997; 
Zhao  et  a/.,  1997)).  The  equiliBrium  point  was 
set  to  11.6  millimeters  from  the  Bottom  of  the 
solenoid  to  the  center  of  mass  of  the  steel  Ball. 
The  coordinate  system  is  chosen  such  that  the 
displacement  vector  points  downwards  from  the 
solenoid  to  the  steel  Ball.  The  local  controller  was 
used  when  the  Ball  was  within  one  millimeter 
of  the  equiliBrium  point  with  a  velocity  having 
aBsolute  value  less  than  0.05  meters  per  second. 


Position  |  m) 


Fig.  6.  Photo  of  the  actual  magnetic  levitation 

testBed  prototyped  at  Ohio  State  University.  Regi-011  °f  naagnetic  levitation  system  s 

phase  space  that  is  marked  as  verified  By  the 
verification  algorithm. 

Outside  this  region,  the  gloBal  controller  was 
invoked. 

rru ~  J  1  - J  ± ~ - j-~  -  1 


J 


{  4.  RELATED  WORK 

The  HyTech  system  (Alur  et  al,  1996)  uses  convex 
polyheclra  to  represent  regions  of  a  hyBrid  system 
and  shares  the  concept  of  verification  through 
exploration  of  the  pre-images  of  the  desired  goal 
states.  HyTech  allows  the  expression  of  properties 
to  Be  verified  as  explicit  mathematical  formulas. 
For  many  properties,  representation  as  a  simple 
formula  is  more  flexiBle  than  the  implicit  repre¬ 
sentation  of  properties  through  cell  annotation. 
HyTech  is  designed  to  easily  represent  hyBrid 
systems,  which  must  Be  represented  By  an  aug¬ 
mented  phase  space  in  our  approach.  However, 
the  geometric  approach  used  here  allows  for  a 
more  straightforward  representation  of  real-world 
uncertainties.  Furthermore,  our  algorithm  is  guar¬ 
anteed  to  terminate,  and  allows  for  a  systematic 
refinement  of  approximation  of  dynamics. 

Recently,  several  researchers  suggested  verifica¬ 
tion  techniques  Based  on  projecting  phase-space 
regions.  In  (Greenstreet  and  Mitchell,  1998),  the 
authors  descriBed  a  method  for  computing  pro¬ 
jection  polyhedra  oBtained  from  integrating  initial 
regions.  While  an  efficient  and  exact  algorithm  ex¬ 
ists  for  two-dimensional  linear  systems  with  con¬ 
vex  spaces,  a  general  higher-dimensional  polyhe¬ 
dra  have  to  Be  reconstructed  from  a  series  of  two- 
dimensional  suBspace  projections.  Because  the  pa¬ 
per  did  not  provide  implementation  details  and 
computational  results  for  the  higher-dimensional 
case,  it  is  difficult  to  evaluate  the  effectiveness 
of  the  algorithm.  The  approaches  in  (Puri  et 
al. ,  1996;  Dang  and  Maler,  1998)  share  a  grid- 
Based  representation  of  phase  space  with  the  al¬ 
gorithm  developed  in  this  paper.  In  comparison, 
our  algorithm  introduces  a  hierarchically  refined 
Bound  of  system  dynamics  to  avoid  unnecessary 
over-approximation. 


5.  CONCLUSIONS 

An  algorithm  for  verification  of  control  laws  using 
phase-space  geometric  modeling  was  presented. 
This  algorithm  is  applicaBle  to  a  wide  range  of 
control  systems  that  are  continuous,  discrete,  or 
hyBrid,  and  can  Be  used  with  a  variety  of  forms 
of  control  laws.  Once  a  Bound  for  measurement, 
controller  output,  and  modeling  uncertainty  is 
oBtained,  considerations  for  these  types  of  un¬ 
certainties  can  easily  Be  incorporated  into  the 
verification  algorithm.  The  algorithm  was  applied 
to  a  nonlinear  controller  for  a  magnetic  levitation 
system,  and  the  resulting  region  of  staBility  was 
compared  to  that  of  the  actual  physical  system. 

Future  avenues  of  research  include  exploring  the 
applicaBility  of  the  algorithm  to  other  real  sys¬ 
tems,  and  investigating  optimal  initial  partitions 


for  different  control  laws.  Furthermore,  more  ac¬ 
curate  and  flexiBle  techniques  for  measuring  the 
region  of  staBility  of  the  physical  maglev  system 
need  to  Be  developed  so  that  the  results  of  the  ver¬ 
ification  algorithm  can  more  readily  Be  compared 
to  those  of  the  actual  system. 


6.  ACKNOWLEDGMENT 

This  work  is  conducted  at  Ohio  State  University, 
supported  in  part  By  ONR  YI  grant  N00014-97-1- 
0599  and  NSF  NYI  grant  CCR-9457802.  We  thank 
S.  Loh  for  designing  and  prototyping  the  maglev 
control  testBed. 


7.  REFERENCES 

Alur,  R.,  T.  Henzinger  and  P.H.  Ho  (1996).  Auto¬ 
matic  symBolic  verification  of  emBedded  sys¬ 
tems.  IEEE  Trans .  on  Software  Engineering. 

Bouajjani,  A.,  R.  Echahed  and  J.  Sifakis  (1993). 
On  model  checking  for  real-time  properties 
with  durations.  Proc .  8th  Annual  Symposium 
on  Logic  in  Computer  Science . 

Bradley,  E.  and  F.  Zhao  (1993).  Phase-space  con¬ 
trol  system  design.  IEEE  Control  Systems 
13(2),  39-47. 

Branicky,  M.  (1995).  Studies  in  HyBrid  Systems: 
Modeling,  Analysis,  and  Control.  PhD  thesis. 
Massachusetts  Institute  of  Technology. 

Dang,  T.  and  0.  Maler  (1998).  ReachaBility  anal¬ 
ysis  via  face  lifting.  Hybrid  Systems:  compu¬ 
tation  and  control ,  Springer-  Verlag  Lecture 
Notes  in  Computer  Science. 

Greenstreet,  M.R.  and  I.  Mitchell  (1998).  Inte¬ 
grating  projections.  Hybrid  Systems:  compu¬ 
tation  and  control ,  Springer- Verlag  Lecture 
Notes  in  Computer  Science. 

Henzinger,  T.,  P.H.  Ho  and  H.  Wong-Toi  (1995). 
Hytech:  the  next  generation.  Proc.  16th  An¬ 
nual  Real-time  Systems  Symposium. 

Hsu,  C.  S.  (1987).  Cell-to-Cell  Mapping.  Springer- 
Verlag,  New  York. 

Loh,  S.  (1997).  An  experimental  environment 
for  designing  and  evaluating  nonlinear  phase 
space  Based  control  laws  with  application 
to  magnetic  levitation.  Master’s  thesis.  The 
Ohio  State  University. 

Puri,  A.,  V.  Borkar  and  P.  Varaiya  (1996).  e- 
approximation  of  differential  inclusions.  Hy¬ 
brid  Systems  III ,  Springer -  Verlag  Lecture 
Notes  in  Computer  Science. 

Zhao,  F.,  S.  Loh  and  J.  May  (1997).  Phase-space 
nonlinear  control  toolBox:  The  maglev  experi¬ 
ence.  Hybrid  Systems  V,  Springer- Verlag  Lec¬ 
ture  Notes  in  Computer  Science. 


Tutorial  MP2 


Intelligent  Simulation 

Feng  Zhao  and  Chris  Bailey-Kellogg 


Fifteenth  National  Conference  on  Artificial  Intelligence 
Madison,  Wisconsin 
Monday,  July  27,  1998 


All  contents  copyright  © 1998 ,  Feng  Zhao  and  Chris  Bailey-Kellogg 


Tutorial  MP2 


Intelligent  Simulation 

Feng  Zhao  and  Chris  Bailey-Kellogg 

Fifteenth  National  Conference  on  Artificial  Intelligence 
Madison,  Wisconsin 


Monday,  July  27,  1998 


Copyright  ©1998, 

Feng  Zhao  and  Chris  Bailey-Kellogg 


All  rights  reserved 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao /Bailey-Kellogg 


AAAI-98  Tutorial  MP2:  Intelligent  Simulation 

Madison,  Wisconsin,  July  27,  1998 


Feng  Zhao  and  Chris  Bailey-Kellogg 

Xerox  Palo  Alto  Research  Center 
3333  Coyote  Hill  Road 
Palo  Alto,  CA  94304 
and 

Intelligent  Simulation  Group 
Dept,  of  Computer  and  Information  Science 
Ohio  State  University 
Columbus,  OH  43210 

Email:  {zhao ,  kellogg}Qparc .  xerox .  com 


Web  Page:  http://www.paxc.xerox.com/zhao 

http://www.cis .ohio-state . edu/ insight 


Page  MP2-1 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Acknowledgement 


•  Ken  Yip  is  a  major  collaborator  in  developing  the  Spatial  Aggregation 
theory  and  language.  Elisha  Sacks  has  collaborated  on  developing 
imagistic  reasoning. 

•  Members  of  Intelligent  Simulation  Group  at  Ohio  State  have  contributed 
towards  the  development  and  implementation  of  spatial  aggregation 
language  and  applications  (Project  INSIGHT  Web  page: 
http://www.cis.ohio-state.edu/insight/).  In  particular,  Ivan  Ordonez, 
Xingang  Huang,  and  Qiang  Wang  helped  define  and  implement  part  of  the 
SAL  library;  Jeff  May  and  Shiou  Loh  developed  the  Maglev  control 
algorithms  and  experiment;  Xingang  Huang  built  a  prototype  program  for 
weather  data  analysis;  Ivan  Ordonez  investigated  the  modeling  and 
analysis  of  diffusion-reaction  systems. 

•  The  work  on  Spatial  Aggregation  is  supported  in  part  by  NSF  Young 
Investigator  award  CCR-9457802,  ONR  Young  Investigator  award 
N00014-97-1-0599,  a  Sloan  Research  Fellowship,  NSF  grant  CCR-9308639, 
and  a  Xerox  Foundation  grant. 


Page  MP2-2 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Tutorial  Roadmap 

Introduction  and  Motivation 

Overview  of  Spatial  Aggregation  (SA): 
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SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
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Physical  Fields  are  Ubiquitous 

Temperature,  sound,  fluid,  ... 

Practical  applications: 

-  Smart  buildings 

-  Constellation  of  space  probes 

-  Weather  map  interpretation 

-  MEMS  arrays 
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Examples  of  Physical  Fields 


A  fluid  field  showing  high  density  regions  and  large  vortex 
structures 
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Film  advancing  mechanism  A  configuration  space 


E.  Sacks  and  L.  Joskowicz 
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Heat  treatment  of  materials 


Temperature  distribution  over  a  piece  of  material 


S.  Vavasis 
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Characteristics  of  Physical  Fields 

Spatially  distributed 
Continuous  and  data  rich 
Multiple  spatio-temporal  scales 
Large  D.O.F.  and  often  nonlinear 
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Conventional  Simulation 

•  Model-simulate-verify  scenario: 

Iterate  till  the  questions  can  be  answered. 

•  Simulation  software  is  monolithic. 


Mostly  numerical  computation. 
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Intelligent  Simulation 

A  body  of  computational  theories,  techniques,  and  programming 
tools  that  combine  numeric,  geometric,  and  symbolic  methods  to 
solve  problems  in  scientific  data  mining  and  engineering  design. 

Characteristics: 

•  Mixed  numeric,  geometric,  symbolic  computation  on 
continuous  and  discrete  representations  of  physical  phenomena 

-  Intelligent  scientific  computing  [Abelson,  Eisenberg,  Halfant, 
Katzenelson,  Sacks,  Sussman,  Wisdom,  and  Yip,  1989]  ' 

•  Articulable  and  structured  models  explicating  simplifying 
assumptions,  causes,  effects,  time,  space,  scales  etc. 

—  Compositional  modeling  [Falkenhainer  &  Forbus,  1991] 
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Tutorial  Roadmap 

•  Introduction  and  Motivation 

>  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

•  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIPAIR,  Fluids 

•  Cognitive  Foundation  and  Related  Work 

•  Spatial  Aggregation  Language  (SAL) 

•  SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
maglev  control  experiment,  diffusion-reaction  morphogenesis 

•  References 

_ y 
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Overview  of  Spatial  Aggregation  (SA) 

•  Input:  data- massive,  numerical  field 
E.g.  weather  maps ,  seismic  signatures,  numerical  simulation 
data 

•  Output:  high-level  description  of  structure,  behavior,  and 
control  actions 

E.g.  stability  regions  and  bifurcation  diagrams  for  dynamical 
systems,  C-space  free  region  diagrams  for  mechanical 
mechanisms,  synthesized  control  reference  trajectories 

•  Task  domains:  Sensor  data  interpretation;  Control 


•  Central  computational  problem:  Uncover  structures  of 
physical  fields 
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Imagistic  Reasoning 


Perceptual  operations  on  image-like,  analogue  representation  of 
physical  systems 


•  Analogue  representation: 

—  Information  rich,  pictorial: 

*  Shannon- Weaver  measure  (lots  of  bits!) 

*  Structures/relations  implicitly  represented 

*  E.g.,  light  intensity  array,  temperature  field,  fluid  motion 
velocity  data,  phase  space 

-  Continuous 

*  The  representation  varies  smoothly  w.r.t.  parameter 
changes  except  for  singular  points 
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Direct  manipulation  of  and  tight  coupling  to  physical  data: 


-  Primarily  perceptual,  secondarily  symbolic 

-  Combine  deductive  reasoning  with  perceptual  processing 

-  No  need  to  generate  intermediate  symbolic  predicates  and  to 
perform  expensive  search  on  them 

-  Reason  about  geometric  structures  and  their  interactions 

-  Explain  behaviors  by  directly  inspecting  structures  and  their 
changes  w.r.t.  perturbations 
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Context 


Central  AI  problem:  map  signal  to  symbols  and  back 

Spatial  Aggregation  as  a  realization  of  imagistic  reasoning 

Draw  upon  techniques  from  computer  vision,  qualitative 
reasoning,  scientific  computing,  and  computational  geometry 

Modeling:  abstraction/economy  of  description/data  reduction 

Control:  goal  to  action;  global  objective  to  local  constraints 
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Tasks  Suitable  for  Spatial  Aggregation 

Explanation  generation 
Computer-aided  tutoring 
Fault  diagnosis  and  prediction 
Scientific  data  mining 

Design  problems  involving  complex  geometries 
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Desired  Properties 


•  Abstractness:  Able  to  compute  abstract  global  properties. 

•  Open-endedness:  Basic  operators  modular  and  composable 
to  support  a  variety  of  task  domains. 

•  Efficiency:  Local  and  non-goal-specific  operators. 

•  Soundness:  Descriptions  consistent  with  known  physical  and 
mathematical  principles. 

•  Succinctness:  Results  containing  qualitatively  important 
distinctions. 
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Reasoning  Tasks 


•  Infer  structural  descriptions.  Identify  field  objects  and 
their  shapes,  sizes,  locations,  distribution,  evolution  over  time. 

•  Classify.  Assign  semantic  labels  to  objects  and  configurations. 

•  Infer  correlations.  Determine  how  geometry/distribution  of 
one  type  of  objects  correlate  with  those  of  another? 

•  Check  consistency.  Given  two  objects  or  configurations,  test 
if  they  are  pairwise  consistent. 

•  Infer  incremental  behavior.  Given  an  instantaneous 
configuration,  predict  its  short-term  behaviors. 

•  Infer  behavioral  descriptions.  Explain  and  summarize 
object  evolution  by  domain-specific  interaction  rules. 
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Basic  Elements  of  Spatial  Aggregation 

•  Field  ontology: 

How  to  describe  the  problem. 

•  Neighborhood  graphs  and  generic  operators: 

How  to  decompose  the  problem  and  formulate  problem-solving 
steps. 

•  Multi-layers  of  spatial  aggregates/transformation: 

How  to  actually  solve  the  problem. 
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Field  Ontology 

•  A  field  is  a  mapping  from  one  continuous  space  to  another: 

Rm  -h.  Rn 

—  A  grey-level  image:  R?  — *■  R1 

—  Temperature  field  of  the  room:  R 3  — >  R1 

—  Wind  velocity  field  in  the  air:  R 3  — *  R3 

•  Metric  on  a  field  — *•  Topology  —*■  Continuity 

•  A  field  is  analogue:  pointwise,  numerical,  information  rich 


Page  MP2-22 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Compare  Field  Ontology  with  Device,  Process, 
Constraint  Ontologies  in  Qualitative  Physics 


HARD! 

modeling  differential  analytical  methods 

equations  ~ 

numerical 

simulation 


physical  measurement 


modeling 


modeling 


modeling 


equivalence 

class  clustering  structural 
description 


process 


envisionment 
incremental  analysis 
process  inference 
qualitative  simulation 


analytical 

functions 


interpret 


qualitative 

behavioral 

description 
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Spatial  Objects 

A  physical  field  exhibits  multiple  spatio-temporal  scales.  E.g. 
temperature  decays  at  different  rate 

Spatial  objects: 

—  By  continuity,  a  continuous  space  partitions  into  a  moderate 
number  of  (open)  regions  separated  by  compact  boundaries 

—  Points  in  a  region  share  similar  properties  w.r.t.  tasks 

—  Focus  on  discrete  regions  and  transitions  among  them  while 
abstracting  away  points  in  a  region 

By  locality,  global  properties  of  a  field  can  be  computed  by 
iteratively  combining  local  properties 
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Elements  of  Field  Ontological  Abstraction 

Spatial  Objects 


—  Geometric  description  ^ 

-  Feature  description 

Examples:  temperature;  pressure;  velocity 

•  Constitutive  Laws 
Examples: 

-  Fourier’s  law:  heat_flux  =  — 

—  Ohm’s  law:  charge_flux  =  —7^7 

-  Hooke’s  law:  stress  = 

•  Spatial  Neighborhood  Structures 
Examples: 
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-  Minimal  spanning  tree 

-  Regular  grid  neighborhood  graph 

-  Delaunay  mesh  neighborhood  graph 

•  Interaction  Rules 
Examples: 

—  Causal  interaction 

-  Consistency  rules 
—  Update  rules 
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Neighborhood  Graphs 

Neighborhood  graph  (N-graph):  nodes  are  objects  in  a  field 
and  edges  explicitly  encode  adjacencies 

Objects  are  aggregated  into  an  N-graph  based  on  spatial 
proximity 

N-graphs  modularize  computation: 

—  As  a  uniform  interface  between  multiple  layers  of  aggregates 

—  As  a  glue  for  operators  that  manipulate,  filter,  transform, 
and  search  aggregates 
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Examples  of  useful  neighborhood  structures: 

—  Phase-space  state  clusters  form  connected  components  of 
N-graph 

—  C-space  free-space  regions  give  rise  to  connectivity  in  N-graph 

N-graphs  support  efficient  computation  on  aggregates  of  spatial 
objects:  search,  classification,  consistency  checking,  etc. 

—  Adjacency  structure  localizes  constraint  propagation  and  path 
search 

—  Inconsistency  among  adjacent  objects  focuses  analysis 

—  Transitive  closure  on  adjacent  objects  form  equivalence  classes 
of  objects 
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A  Minimum  spanning  tree 
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Two  adjacent,  counter-rotating  velocity  streamlines  A  and  B  in  an 
incompressible  planar  fluid  flow.  Inconsistency  rule  for  A  and  B 
flags  that  there  must  be  missing  features,  in  this  case  recirculation 
zones,  in  the  annular  region  between  A  and  B. 
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Multi-Layer  Transformation  of  N-Graphs 

A  small  set  of  operators  construct  and  transform  spatial 
aggregates 

Identical  set  of  operations  at  each  layer,  parameterized  by  task 
and  domain  specific  metric  and  relations 

-  Aggregate  forms  a  neighborhood  graph  explicitly  encoding 
adjacencies. 

-  Classify  forms  equivalence  classes  of  similar  neighboring 
objects. 

-  Redescribe  maps  equivalence  classes  to  higher-level  objects. 
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Higher-Level  Objects 
Redescribe  ' k  Disaggregate 

/f  - ^  r  Structural  description 

Map,  Filter,  C  ^^as^es ° /  Behavioral  description 

geom«»icopSVd!!!^|assify  ^  > 

^"\Aggregate/^  r 

'  (  spatial  A  »-(  N-graph  )  M 

V  V  objects  J  V  y  M 

Update* — ^ - - f 


Consistent? 


Redescribe  Disaggregate 
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Spatial  Aggregation  Language  (SAL) 

•  Support  rapid  prototyping  of  problem  solvers  for  imagistic 
reasoning  tasks 

•  Provide  data  types  and  operators 

•  Modular  construction  of  transformations,  organized  by 
parameterized  N-graph  constructs 
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Language  Features 

•  Data  types: 

N-graph  and  its  constructors,  accessors,  modifiers. 

Examples  of  N-graph:  4- adjacency,. MS T,  and  Voronoi  diagram. 

Field  and  its  constructors,  accessors,  modifiers. 

Examples  of  Field:  array,  grid,  K-D  tree,  etc. 

•  Interface  operators: 

aggregate,  classify,  re-describe,  localize,  search, 
incremental-analyze ,  pairwise-consistent? , 
consistent? 

A  user  must  specify  the  neighborhood  relation,  field  metric,  and 
equivalence  relation  for  these  operators. 

•  Geometric  utilities:  intrinsic-geometry,  contain?, 
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intersect , 


d ,  6. 


•  Interface  to  numerical  and  image  processing  libraries: 


FFT,  convolution,  integrator,  linear  system  solver, 
vector /matrix  algebra. 
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SA  Example:  Trajectory  Bundling 


Task:  given  a  set  of  sample  points,  to  identify  groups  of  trajectories 
with  similar  limit  behaviors. 


Page  MP2-36 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao /Bailey- Kellogg 


Page  MP2-37 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Trajectory  Bundling  Data  Flow 


trajectory—^  aggregate  - 
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SA  Example:  Boundary  Tracing 

Task:  to  group  boundary  segments  from  the  same  object. 
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(a)  boundary  pixels  (b)  4-adjacency  graph 
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(c)  boundary  segment  graph  (d)  object  contours 
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Boundary  Tracing  Data  Flow 
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Tutorial  Roadmap 

•  Introduction  and  Motivation 

•  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

>  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIPAIR,  Fluids 

•  Cognitive  Foundation  and  Related  Work 

•  Spatial  Aggregation  Language  (SAL) 

•  SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
maglev  control  experiment,  diffusion-reaction  morphogenesis 

•  References 
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Examples  of  Spatial  Aggregation 

•  KAM:  analyzing  nonlinear  dynamical  systems  (Ken  Yip) 

•  MAPS:  synthesizing  control  laws  (Feng  Zhao) 

•  HIP  AIR:  performing  kinematic  analysis  of  mechanisms  (Leo 
Joskowicz  &  Elisha  Sacks) 

•  Mining  data  from  fluid  dynamics  simulation  (D.  Silva.  N. 
Zabusky,  et  al.;  Ken  Yip) 
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KAM 

•  Task:  Interpret  qualitative  behaviors  of  Hamiltonian  systems 
such  as  the  solar  system 

•  Input:  state  equation  of  a  Hamiltonian  system,  parameter 
ranges. 

•  Output:  a  summary  of  qualitatively  distinct  behaviors 

•  Key  ideas: 

—  Phase-space  geometric  analysis 

—  Classification  of  geometric  objects  based  on  their  shapes 

—  Local  compatibility  rules  and  constraint  propagation 

•  Application:  KAM  was  used  in  solving  an  open  problem  in  fluid 
dynamics  -  predicting  onset  of  chaotic  motion  in  wave  tanks 
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Phase  Portrait  of  a  Hamiltonian  System 

Henon’s  description  of  the  motion  of  a  star  within  a  galaxy: 

xn+i  =  xn  cos  a  -  {yn  -  x2n)  sin  a 
Vn+1  =  Xn  sin  a  +  {yn  -  x\ )  cos  a 

Important  questions:  when  does  the  system  undergo  simple 
periodic  motion?  or  even  chaotic  motion? 


A  Hamiltonian  system  does  not  dissipate  energy. 
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Phase-Space  Geometric  Analysis 

•  Poincare’s  Idea:  geometries  of  phase  space  encode  complex 
local  and  global  dynamical  behaviors. 

E.g.  Swinging  pendulum  in  a  magnetic  field. 

•  Terminology: 

—  Phase  space:  a  space  spanned  by  state  variables  of  a 
dynamical  system  (E.g.  a  n-D  Euclidean  space) 

—  Vector  field:  a  mapping  that  takes  a  point  in  phase  space  to 
a  direction 

—  Orbit:  an  integral  curve  of  the  vector  field 

—  Phase  portrait:  union  of  orbits  filling  a  phase  space 

—  Bifurcation:  qualitative  changes  in  behaviors  as  system 
parameters  vary 
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Phase-Space  Description  of  Behaviors 

•  State:  a  point  in  phase  space 

•  Trajectory  (orbit):  1-D  curve 

•  Equilibrium  state:  a  stationary  point  in  vector  field,  classified 
as  attracting  (stable),  repelling  (unstable),  and  saddle 
(meta-stable). 

•  Limit  cycle  (periodic  orbit):  a  closed  1-D  curve 

•  Chaotic  orbit:  irregular  trajectory  with  no  apparent  structure 

•  Basin  of  attraction:  a  region  that  maps  to  an  attractor  in  the 
limit  (also  called  the  stability  region) 

•  Poincare  section:  a  slice  of  phase  space;  behaviors  are 
analogously  defined  in  the  section:  periodic,  almost  periodic, 
island  chain,  separatrix,  chaotic. 
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Examples  of  Phase-Space  Orbits 


Attractor  Repellor  Saddle 


An  attracting 
limit  cycle 


A  chaotic  orbit  Two  basins  of 
(in  3D  or  higher)  attraction  (left/right) 
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Good  References  on  Phase-Space  Analysis 

•  M.W.  Hirsh  and  S.  Smale,  Differential  Equations,  Dynamical 
Systems  and  Linear  Algebra.  Academic  Press,  NY,  1974.  (A 
gentle  introduction  to  linear  algebra  and  dynamical  systems) 

•  R.H.  Abraham  and  C.D.  Shaw,  Dynamics:  the  geometry  of 
behaviors.  Addison- Wesley,  1992.  (A  wonderful  volume  of 
pictorial  introduction  to  concepts  in  dynamics  and  examples) 

•  J.  Guckenheimer  and  P.  Holmes,  Nonlinear  Oscillations, 
Dynamical  Systems,  and  Bifurcations  of  Vector  Fields. 
Springer- Verlag,  New  York,  1983.  (A  more  advanced  Graduate 
text  on  nonlinear  dynamical  system  analysis) 
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How  Does  KAM  Recognize  an  Orbit? 

Embed  the  orbit  in  a  data  structure  called  MST 

Compute  the  distinguishing  characteristics  (branching  factor, 
edge  length,  etc.)  of  MST 

Apply  pre-defined  classification  rules  to  parse  the  orbit  into  one 
of  the  known  types:  periodic  orbit  (fixed  point),  quasiperiodic 
orbit  (KAM  curve),  island  chain,  separatrix,  chaotic  orbit 


Key  Observation:  KAM  performs  similar  computations  in 
searching  phase  spaces  and  parameter  spaces,  after  individual 
orbits  are  identified. 
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RAM’s  Local  Consistency  Rules 

•  Orbits  do  not  intersect 

•  Neighboring  orbits  have  to  be  compatible  in  flow  directions 

KAM  uses  the  local  rules  to  incrementally  identify  missing  features 
of  phase  space,  avoiding  an  exhaustive  search 
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Examples  of  Spatial  Aggregation 


•  KAM:  analyzing  nonlinear  dynamical  systems  (Ken  Yip) 

>  MAPS:  synthesizing  control  laws  (Feng  Zhao) 

•  HIP  AIR:  performing  kinematic  analysis  of  mechanisms  (Leo 
Joskowicz  Sz  Elisha  Sacks) 

•  Mining  data  from  fluid  dynamics  simulation  (D.  Silva,  N. 
Zabusky,  et  al.;  Ken  Yip) 
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MAPS 


•  Task:  Synthesize  control  laws  for  dissipative  systems  based  on 
a  qualitative  analysis  (e.g.  Balancing  a  pole) 

•  Input:  state  equation  of  a  dissipative  system,  initial  and  goal 
states,  optimality  constraints,  admissible  control  values. 

•  Output:  control  paths  connecting  the  initial  and  goal  states 
and  satisfying  design  constraints. 


Key  ideas: 

—  Path  search  in  phase  space 

—  Flow  pipes  (equivalence  classes  of  behaviors) 

—  Flow  pipe  graph  (reachability) 

Application:  MAPS  was  used  to  synthesize  a  nonlinear,  global 
control  law  for  a  magnetic  levitation  system. 
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Problem:  Stabilizing  a  Buckling  Steel  Beam 

Buckling  in  steel  beams  (under  axial  loads)  induces  structural 
failures  in  buildings  or  bridges. 


Thin  Steel  Beam  ^ _ ► 

Displacement  (x) 

How  to  stabilize  buckling  by  controlling  marginal  stability? 
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Control  Synthesis  as  Path  Search  in  Phase  Spaces 

•  Control  law  as  a  path  connecting  initial  and  goal  states  in 
phase  space 

•  Searching  out  a  stack  of  continuous  phase  spaces  parameterized 
by  different  control  actions  —  Expensive!!! 

jJ”\  /  Phase  portrait  1 
goal  point\  ...  / 


L _ 

i 

T 

U3  j  J .  phase  portrait  2 


7...  .**  phase  portrait  3 


rUl 

L  initial  point 
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Flow  Pipes 

•  Partition  a  continuous  space  into  a  manageable  collection  of 
discrete  objects 

•  Each  flow  pipe  represents  an  equivalence  class  of  trajectories: 

—  Exhibiting  similar  behaviors  (e.g.  flow  into  the  same  sink) 

-  Homotopy  equivalent  (continuously  deformable  to  each 
other) 


Trajectories  flowing  into  the  same  sink  A  flow  pipe 
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Flow-Pipe  Graph 

•  Formed  by  intersecting  flow  pipes  from  a  stack  of 
parameterized  phase  spaces 

•  Flow  pipe  graph  encodes  path  reachability  and  optimality 
constraints 

-  Edge  weight  represents  “goodness”  of  the  edge 

—  Shortest  path  search  suffices 


let't-attracior  (-1.41. 0) 


right-aitractor(1.4I,0) 
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Find  Solution  by  Searching  Out  Flow-Pipe  Graph 
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Discussion  I 


•  The  input  point  sets  to  both  KAM  and  MAPS  come  from 
numerical  simulation  of  system  models  or  sensor  measurements 

•  While  KAM  deals  with  cross-section  of  3D  structures,  MAPS 
processes  3D  (or  higher)  structures  directly  and  uses  the 
qualitative  description  to  synthesize  nonlinear  control  actions 

•  Although  designed  for  different  tasks,  KAM  and  MAPS’ 
computational  structures  are  strikingly  similar: 

—  Object  aggregation,  classification,  and  re-description  at  each 
layer 


-  Aggregate  objects  are  manipulated  as  primitive  objects  at 
the  next  higher  level 
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Examples  of  Spatial  Aggregation 


•  KAM:  analyzing  nonlinear  dynamical  systems  (Ken  Yip) 

•  MAPS:  synthesizing  control  laws  (Feng  Zhao) 

>  HIP  AIR:  performing  kinematic  analysis  of  mechanisms  (Leo 
Joskowicz  &  Elisha  Sacks) 

•  Mining  data  from  fluid  dynamics  simulation  (D.  Silva,  N. 
Zabusky,  et  al.;  Ken  Yip) 
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HIPAIR 


•  Task:  Perform  kinematic  analysis  of  fixed-axes  mechanisms 
(e.g.  gear  box) 

•  Input:  Shape  and  motion  type  description  for  each  interacting 
pair  of  parts  in  a  mechanism 


•  Output:  Realizable  configurations  of  the  mechanism 
represented  by  a  CS  region  diagram 

•  Key  ideas: 


—  Feasibility  analysis  in  configuration  space  (CS) 

—  Incremental  computation  exploiting  spatial  adjacency  of  CS 
regions,  avoiding  an  exhaustive  search 
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•  Application:  HIPAIR  is  used  to  analyze  2,500  common 
mechanisms  from  Artobolevsky’s  four-volume  encyclopedia 
Mechanisms  in  Modern  Engineering  Design: 


—  Include  couplers,  indexers,  and  dwells  used  in  printing  presses, 
mills,  motion-picture  cameras,  and  cars 

-  Found  66%  kinematic  pairs  and  58%  mechanisms  are  feasible 
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Configuration  Space  (CS) 

Each  dimension  for  a  single  D.O.F.  of  a  mechanism. 

E.g.  The  CS  for  a  rigid  part  in  a  plane  is  3D:  two  for 
translational  D.O.F.  and  one  for  rotational  D.O.F. 

Point:  a  configuration  of  the  mechanism 

Feasible  configuration:  physically  realizable  configuration 

Infeasible  configuration:  physically  unrealizable  configuration 
(e.g.  two  overlapping  rigid  parts) 

Free  space  region:  a  set  of  feasible  configurations 

Blocked  space  region:  a  set  of  infeasible  configurations 

Region  diagram:  a  graph  with  free  space  regions  as  nodes  and 
spatial  adjacencies  as  edges 
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An  Example  of  Configuration  Space 


A  robot  in  a  2D  physical  space 

Its  CS  for  translations 

^^Adapted  from  P.H.  Winston..  1992 

y 
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Computational  Structure  of  HIPAIR 
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Discussion  II 

HIPAIR  exhibits  similar  computational  patters  as  KAM  and 
MAPS,  using  the  same  set  of  operators 

Our  objective  is  to  extract  these  common  building  blocks  to 
better  understand  why  these  programs  work  and  to  build 
future  programs  using  these  blocks. 
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Examples  of  Spatial  Aggregation 

•  KAM:  analyzing  nonlinear  dynamical  systems  (Ken  Yip) 

•  MAPS:  synthesizing  control  laws  (Feng  Zhao) 

•  HIPAIR:  performing  kinematic  analysis  of  mechanisms  (Leo 
Joskowicz  &  Elisha  Sacks) 

>  Mining  data  from  fluid  dynamics  simulation  (D.  Silva,  N. 
Zabusky,  et  al.;  Ken  Yip) 
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Interpreting  Fluid  Simulation  Data 

•  Visiometrics  (Silver  and  Zabusky):  extract  and  track  features 

•  Structural  inferences  as  an  example  of  Spatial  Aggregation 
(Yip):  extract  and  classify  structures 


An  example  of  fluid  data  (Raleigh-Taylor  instability): 
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Visiometrics 

Task:  Extract  and  track  features  from  fluid  simulation  data 
sets  (e.g.  low  pressure  regions,  high  vorticity  areas) 

Input:  Gridded  data  set  over  a  spatial  domain 

Output:  Features  and  their  evolution  in  time 

Key  ideas: 

-  Regions  of  fluid  field  as  coherent  objects 

-  Field  segmentation 

-  Object  correspondence 


Application:  visualize  turbulence  data 


V 
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Extracting  Objects 


•  Fluid  objects:  a  set  of  adjacent  points  above  or  below  a 
threshold  value  plus  their  boundaries 

•  Extracting  objects:  use  3D  segmentation  or  region  growing  to 
extract  connected  thresholded  region 

•  Object  attributes:  mass,  centroid,  maximum,  volume,  moment, 
bounding  surface,  skeletons 
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Tracking  Objects 


Correspondence: 


—  Match  an  object  in  a  field  with  one  in  another  field 

-  Use  object  attributes 

Two  modes  of  tracking: 

—  Postprocessing:  identify  all  objects,  then  correlate 

-  Preprocessing:  identify  objects  in  the  initial  frame  and 
search  for  matching  objects  in  subsequent  frames 
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Evolution  of  Objects 


•  Continuation:  object  persists  over  time 

•  Birth/Death:  creation  or  disappearance  of  objects 

•  Bifurcation:  object  breaks  into  pieces 

•  Collide:  objects  merge  to  form  a  single  object 

An  object  is  said  to  correspond  to  another  if  their  overlapping 
region  exceeds  certain  threshold  value. 
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Application  of  Spatial  Aggregation: 
Infer  Structures  in  Fluid  Data 


•  Task:  Extract  structures  from  fluid  simulation  data  sets  (e.g. 
vortex  bundles  and  their  spatial  adjacency) 

•  Input:  Data  set  over  a  spatial  domain 

•  Output:  Structural  description  (such  as  vortices,  streaks,  shear 
layers) 

•  Key  ideas: 

-  Object  cohesiveness 

-  Aggregate  and  classify  object  structures 

—  Explaining  physics  by  structural  morphogenesis  of  fields 

•  Application:  build  geometric  models  for  fluid  data 

V  J 
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The  phenomenon  is  explained  in  terms  of  objects,  their  spatial 
distribution  and  interaction,  their  temporal  evolution,  their  changes 
in  shapes,  and  birth/death  of  the  objects.  [Yip,  IJCAI97] 
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Aggregation  and  Classification 


•  Field  data  is  aggregated  into  isosurfaces  by  a  modified 
marching  cube  algorithm 

•  A  vortex  object  is  defined  as  a  set  of  adjacent  curves  that  share 
similar  properties 

•  Extract  shape  description  for  a  vortex  using  generalized 
cylinders 

Future  work: 


•  Correlate  spatial  objects 

•  Establish  cause-effect  relation 
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Tutorial  Roadmap 

•  Introduction  and  Motivation 

•  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

•  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIPAIR,  Fluids 

>  Cognitive  Foundation  and  Related  Work 

•  Spatial  Aggregation  Language  (SAL) 

•  SA  Applications: 

Distributed  optimization  and  control,  w’eather  data  analysis, 
maglev  control  experiment,  diffusion- reaction  morphogenesis 

•  References 
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Cognitive  Foundation  and  Related  Work 

Development  of  Object  Perception  (Spelke  et  al.) 

Visual  Routines  (Ullman) 

Visual  and  Spatial  Reasoning 
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Object  Perception 


How  does  our  perceptual  system  extract  and  track  discrete  objects 
from  cluttered  environments? 


Two  aspects  of  the  problem: 


•  Individuation  and  unit  formation:  what  counts  as  a  single 
entity  and  how  to  carve  up  a  scene  into  distinct  bodies? 

•  Object  persistence  (identification  and  correspondence):  how  do 
multiple  descriptions,  over  time  or  space,  pertain  to  a  single 
entity? 
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•  Cohesion:  An  object  is  internally  connected  and  externally 
bounded;  it  maintains  its  connectedness  and  boundedness  over 
time  and  space. 

•  Continuity:  An  object  exists  continuously  and  moves  on  a 
path  that  is  connected  over  time  and  space. 

How  do  we  extract  meaningful  objects  from  a  continuous  field 
based  on  spatio-temporal  cohesion  and  continuity? 


V 
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Infants’  Perception  of  Objects 


Three  Principles  of  Spelke  et  ah: 


Cohesion:  A  moving  object  maintains  its  connectedness  and 
boundaries 

xi  ^  Cohesive 


lx  In  violation  of  cohesion 


Contact:  Objects  move  together  if  and  only  if  they  touch 

In  contact  No  contact 

X  i  _  X  a 


Page  MP2-89 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


•  Continuity:  A  moving  object  traces  exactly  one  connected  path 
over  space  and  time 

v*  Continuous 


Discontinuous 


Solidity  violation 
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Ullman’s  Visual  Routines 

•  A  set  of  computational  routines  for  analyzing  shape  properties 
and  spatial  relations  such  as  elongation,  inside/ outside  relation, 
and  connectedness. 

E.g.  Boundary  tracing,  area  activation,  counting  intersections. 

•  Does  not  require  object  recognition 

Examples  of  spatial  properties/relations: 

0 

Inside-outside  Elongation  Closure  Pointiness 
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Requirements 

Abstractness:  establish  abstract  properties  and  relations 

—  Support  for  a  property  or  relation:  the  set  of  points  that 
give  rise  to  the  property  or  relation. 

—  Abstract  property  or  relation  is  one  with  non-local  support 
E.g.  Inside/outside  relation;  Closure  property. 

Open-endedness:  establish  a  large  variety  of  relations  and 

properties 

—  Due  to  computational  feasibility  considerations 

—  Different  routines  are  assembled  from  a  small  number  of 
elementary  routines 

—  New  routines  are  assembled  from  the  same  set  to  meet 
additional  computational  goals 
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Complexity:  efficiency  in  using  space  and  time 

-  Use  the  same  set  of  routines  for  different  tasks 

-  Apply  the  same  computation  to  different  locations 

-  Need  selective  attention  and  shift  of  focus. 
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Computational  Considerations 


What  are  the  base  set  of  routines? 


How  are  complex  routines  built  out  of  simpler  ones? 
Where  and  how  are  routines  triggered? 


How  are  routines  sequenced? 
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Qualitative  Spatial  Reasoning 

•  MD/PV  theory  (Forbus  et  al.,  1991) 

—  Metric  Diagram  (MD):  numerical  and  symbolic  descriptions 
of  a  scene 

—  Place  Vocabulary  (PV):  a  quantization  of  the  space 
according  to  task-specific  criteria 

•  A  qualitative  model  for  distributed  parameter  physical  fields 
(Lundell,  1996) 

—  Region  partition;  quantity  space;  influence  propagation 

•  Spatial  hierarchy  (Kuipers  and  Levitt,  1988) 

—  Four-level  topological  and  metric  descriptions 

—  Robot  navigation  and  mapping  of  spaces 
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Spatial  calculus  (Randell,  Cui,  and  Cohn,  1992) 

—  Region-connection  calculus  (RCC)  based  on  binary 
topological  relations 
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Diagrammatic  reasoning 


•  Gelernter  geometry  theorem  prover  (Gelernter,  1963) 

•  Nevins’  geometry  theorem  prover  (Nevins,  1975) 

•  Constraint  propagation  (Stallman  and  Sussman,  1977) 

•  Diagrammatic  representation  (Larkin  and  Simon,  1987) 

•  A  comprehensive  collection  of  papers  (Glasgow,  Narayanan, 
Chandrasekaran,  1995) 
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Analogue  simulation 

•  whisper  (Funt,  1980) 

•  “Molecular”  simulation  (Gardin  and  Meltzer,  1989) 

•  Direct  motion  simulation  (Chandrasekaran  and  Narayanan, 
1990) 
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Tutorial  Roadmap 

•  Introduction  and  Motivation 

•  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

•  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIP  AIR,  Fluids 

•  Cognitive  Foundation  and  Related  Work 
>  Spatial  Aggregation  Language  (SAL) 

•  SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
maglev  control  experiment,  diffusion- reaction  morphogenesis 

•  References 
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SAL  Introduction 


Goal:  to  support  programming  in  the  style  of  SA. 

•  Data  types  and  operations  at  the  right  level  of  abstraction. 

•  Interactive  programming  environment  for  exploring  structures 
in  physical  data. 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


SAL  Data  Types  Overview 

Primitive  object:  representation  of  a  physical  object. 


Compound:  collection  of  primitive  objects  or  compounds. 
Particularly  useful  compounds: 

—  Sets:  Spaces,  equivalence  classes,  etc. 

-  Relations:  Fields ,  Ngraphs,  topological  substructure,  etc. 


Abstraction:  compound  — +  higher-level  primitive. 
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Physical  Objects: 

Structure  vs.  Geometric  Properties 

Topological  structure  specifies  how  parts  are  related. 

Geometric  properties  (e.g.  edge  length,  angle,  curvature,  area) 
depend  on  metric,  coordinate  system,  etc. 

Ex:  same  structure,  different  coordinate  system  or  coordinates: 
y*  y  x  W)  .  y * 


Wy - 

X 

X 

- * 

x 

x 

x 

'x 

,x' 

'x 

I— 


(0.-3)  l- 

x 

y 


-H-M-i-h-y* 

x 


Separate  data  types  for  structure  and  geometric  properties. 
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Topological  Structure 

Specify  how  a  physical  object’s  parts  are  related  to  each  other: 

•  Implicitly  by  geometric  construction 
Ex:  x2  +  y2  <  r2 

•  Explicitly  by  relations  among  components 

—  Space/subspace  relation;  e.g.  cube  and  its  faces 
—  Adjacency;  e.g.  collection  of  triangles  in  a  mesh 

•  Cell  Complex  is  a  particular  hierarchical  explicit  representation. 
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•  Homeomorphic  (continuously  deformable)  to  ball  of  same 
dimension. 

•  Ex:  point,  closed  line  segment  or  curve  segment,  triangle  with 
interior  or  surface  patch,  solid  cube. 

•  Hierarchical  structure: 

—  A  cell  has  faces  that  are  lower-dimensional  cells. 

-  A  cell’s  proper  faces  are  its  faces  of  the  next  lower 
dimension. 
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Cell  Complex 


Collection  of  cells  such  that 
1.  Each  cell’s  faces  are  in  the  complex. 


2.  A  non-empty  intersection  of  two  cells  is  a  face  of  each. 
•  Legal  cell  complexes: 


Illegal  cell  complexes: 
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Example  Cell  Complex  Queries 

Queries  for  structure  of  cell  complex  (only  proper  relationships 
illustrated  above): 

•  Face :  cell  structure 

Ex:  ABCD  — ►  AB  -*  A 

•  Co-face:  inverse  of  face 
Ex:  A  — »•  AB  —>  ABCD 


•  Adjacency:  share  a  face 
Ex:  AB  ->  BC 
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Geometric  Properties 


Geometric  properties  for  a  structure  depend  on  distance  function, 
coordinate  system,  etc. 

•  Point:  coordinates 

•  Segment:  length 

•  Curve:  length,  curvature  at  given  points 

•  Quadrilateral:  angles,  edge  lengths,  area 

Geometric  Objects  derived  from  structure  objects  cache  appropriate 
properties. 
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Metric  Space 


A  Metric  Space  defines  a  distance- measuring  function  ( metric )  and 
reference  frame  relative  to  which  geometric  properties  are  defined. 

•  Coordinate  Space  does  this  in  terms  of  a  specific  coordinate 
system. 

•  Example  metrics: 

-  2-D  Euclidean: 

d((«i,  yi),  (a?2, 2/2))  =  ‘sf (®2  -  zi)2  +  (2/2  -  2/i)2- 

-  Distance  between  polygons  based  on  centroids. 
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Geometry  Construction 

Given  a  structure  and  a  metric  space,  establish  geometric 
properties  for  the  structure. 

•  Algebraically 
Ex:  x2  +  y2  <  r2 

•  Bottom-up,  from  geometries  of  substructure 

Ex:  Given  lengths  of  triangle’s  sides,  compute  angles  and  area. 

•  Top-down,  establishing  geometries  of  substructure 

Ex:  Given  angles  and  area  of  triangle,  compute  lengths  of  sides. 
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Local  and  Embedding  Metric  Spaces 

•  A  geometric  object  defines  a  local  metric  space  for  its 
substructure. 

Ex:  1-D  parameterization  of  a  curve,  2-D  parameterization  of  a 
square 


x=0  x=l 


•  A  geometric  object  can  be  embedded  in  another  metric  space. 
Ex:  2-D  square  embedded  in  a  3-D  cube 
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Transformations 


Geometric  properties  are  relative  to  a  metric  space,  but  can  often 
be  easily  transformed  from  one  metric  space  to  another,  related  one. 

•  From  local  metric  space  to  embedding  metric  space 

Ex:  point’s  coordinates  on  edge  to  coordinates  in  rectangle 


t  =  0.5 
(x,y)  =  (0.0.5) 


•  From  embedding  metric  space  to  local  metric  space 

Ex:  point’s  coordinates  in  rectangle  to  coordinates  on  edge 
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Between  metric  space  and  transformed  version 
Ex:  2-D  Euclidean  to  rotated  2-D  Euclidean  (area,  angles,  etc. 
remain  constant;  coordinates  change) 
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Physical  Object  Representations:  Summary 

Separate  structure  from  geometric  properties. 

Define  structure  hierarchically  with  cell  complex. 

Define  geometric  properties  for  given  structure  and  metric 
space. 


Page  MP2-117 


AAAI9S  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Compounds 


A  Compound  is  a  collection  of  primitive  objects  or  compounds. 

•  Flat  compounds:  collections  of  primitive  objects 

•  Structured  compounds:  collections  of  other  compounds 
Ex:  a  relation  is  a  set  of  pairs  of  objects. 


SAL  includes  a  number  of  predefined  compound  types  with  special 
semantics. 
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Space 

A  Space  is  a  collection  of  primitive  objects. 

•  Select  sub-spaces  satisfying  predicate. 

Ex:  all  quadrilaterals  created  so  far 
Ex:  all  faces  of  a  particular  cube 

•  Distribute  operations  over  objects  in  space. 

Ex:  for  each  quadrilateral,  find  its  area. 

•  Extract  global  property  of  collection. 

Ex:  find  average  area  of  all  quadrilateral  objects. 
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Metric  Space  Indexing 

In  addition  to  defining  a  metric,  a  Metric  Space  can  also  cache 
indexing  information  for  spatial  queries  on  its  objects. 

•  Nearest  object  to  a  given  object  (or  coordinates). 

•  Objects  within  some  given  distance  of  an  object  (or 
coordinates). 


Common  indices  include  arrays,  k-d  trees,  etc. 


V 
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Field 


Mapping  Rn  — »•  Rm. 


•  Associates  feature  points  with  position  points. 
Ex:  {(point,  temperature)}  {R2  — ►  R1) 

Ex:  {(point,  wind  velocity)}  (R2  — ►  R2)  / 

•  Element-wise  operations  (implicitly  distributed): 
Ex:  add/scale  fields 

•  Field  values  can  be  interpolated. 
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Ngraph 


Set  of  neighborhood  adjacencies  relating  objects  in  a  space: 
{(object,  neighbor)}. 

Adjacencies  localize  computation: 

-  Local  comparisons 

Ex:  how  does  the  wind  direction  here  compare  to  that  at 
neighbors? 

Ex:  how  far  away  is  this  neighbor  compared  to  others? 

-  Local  interaction  rules 

Ex:  update  temperature  at  a  node  based  on  temperatures 
at  surrounding  nodes. 
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Ngraph  Manipulation 

•  Explicit  construction:  specify  neighbors  for  each  object. 

•  Implicit  construction:  specify  criterion. 

Ex:  delaunav  triangulation  or  fc-nearest  neighbors 

•  Graph-theoretic  operations  manipulate  structure. 

Ex:  union,  intersection,  subgraph,  closure,  connected 
components,  search,  neighborhood  walk 


AAAI9S  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Page  MP2-125 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao /Bailey-Kellogg 


Ngraph  Equivalence  Classes 

•  SA  theory  provides  the  classify  operator  to  find  equivalence 
classes  of  objects  in  Ngraphs. 

•  Ex:  isothermal  regions  with  temperatures  in  the  same  bin. 

Ex:  trajectories  in  the  wind  vector  field. 

•  An  equivalence  class  is  the  set  of  objects  in  the  transitive 
closure  of  the  intersection  of  a  neighborhood  relation  with  an 
equivalence  predicate. 

•  Goal:  an  efficient  mechanism  for  computing  equivalence  classes. 
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Ngraph  Equivalence  Class  Mechanism 

1.  Localize  computation  with  Ngraph. 


X 


2.  Eliminate  inconsistent  adjacencies. 


X 


3.  Find  connected  components  in  resulting  graph. 


^  X7 

\  /•  / 

/  •)  I •  v 
/•/  \#\ 
(•7  \#) 


Page  MP2-127 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Compounds:  Summary 


Space  treats  objects  as  a  group. 

Field  relates  objects  and  features  embedded  in  a  physical 
continuum. 

Ngraph 

1.  Explicates  object  adjacency. 

2.  Localizes  computation. 

3.  Supports  efficient  extraction  of  coherent  groups. 
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Abstraction 


Given  a  group  of  objects  and  their  structure,  abstract  them  into  a 
single  higher-level  primitive  object. 


•  Ex:  bottom-up  construction  of  Cell  Complexes. 

•  Ex:  redescription  of  equivalence  classes  in  Ngraph. 


•  Additional  operations  make  sense  on  the  higher-level  object. 
Ex:  curvature  of  a  curve  segment  previously  represented  by 
sampled  points. 


Associated  features  can  “tag  along. 
Ex:  average  temperature  in  region 
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SAL  Library  Summary 


A  Ch — b  library  provides  a  number  of  implementations  and 
operations  for  SAL  data  types. 

•  Primitive  objects 

—  Represent  localized  chunks  of  space  and  associated  features. 

—  Cell  complexes 

*  Point,  segment,  n-line,  n-gon 

*  Face,  co-face,  adjacency 


—  Geometric  objects 

*  Point,  segment,  polyline,  polygon 

*  Coordinates,  volume 
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•  Compounds 


-  Organize  groups  of  primitive  objects. 

-  Space 

*  Topological  space,  Euclidean  metric  space 

*  Map,  filter,  nearest  member 

-  Field 

*  Scalar  field,  vector  field 

*  Add,  scale,  combine,  interpolate 

-  Ngraph 

*  Delaunay,  MST,  A;-nearest,  grid 

*  Union,  subgraph,  connected  components 


\ 
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'  •  Abstraction 

—  Map  groups  of  objects  and  their  structure  into  single  aggregate 
objects  that  can  be  treated  as  primitives. 

—  Cell  complex  construction,  convex  hull,  spline  construction 

—  Redescribe,  localize 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


SAL  Programming  Environment  Demo 

SAL  provides  an  interpreted,  interactive  programming 
environment,  layered  over  the  library  implementations. 

Demo:  compute  paths  of  heat  flow. 

1.  Localize  computation  with  an  ngraph. 

2.  Simulate  diffusion  with  local  interaction  rules. 

3.  Calculate  gradient  vectors. 

4.  Filter  ngraph,  preserving  edges  roughly  parallel  to  vectors. 

5.  Group  resulting  edges  into  curves. 
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//  Establish  a  single  source  location  and  its  state 
src  =  graphical_select (points) 

sources  =  set(src);  source.value  =  state (sources ,  init_val=l) 

//  Establish  a  field  of  temperature  values  for  the  points;  simulate  diffusion 
temp  =  value^f ield(points ,  init_val=0) 

interior  =  filter (p  in  points,  size (neighbors (grid,  p))  ==  4) 
update_converging(p  in  interior,  temp, 

average (map (neighbors (grid,  p) ,  temp))  + 
exists (source.value(p))  ?  sourc e_ value (p)  :  0) 
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//  Form  isotherms  by  classifying  neighboring  points  as  to  whether  or  not 

//  their  temperatures  fall  in  the  same  bin 

temps  =  map(points,  temp);  dt  =  max (temps) -min (temps) 

isotherms  =  classify (a  in  adj_8_graph,  same_bin(a,  temp,  width=dt/5)) 
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SAL  Programming  Style 


1.  Formulate  problem. 

•  Describe  the  task  in  terms  of  geometric/topological  structures. 
Ex:  in  trajectory  bundling  (running  example),  the  task  is  to 
determine  qualitatively-similar  states.  Geometrically,  the  states 
are  represented  as  points  and  their  qualitative  behaviors  as 
trajectory  bundles. 

•  Input:  spatially-distributed  data,  captured  as  a  field. 

Ex:  sample  points  in  state  space. 

•  Output:  high-level,  abstract  descriptions  derived  from  the  data. 
Ex:  trajectory  bundles. 
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SAL  Programming  Style 

2.  Identify  relevant  domain  knowledge. 

•  Continuity  and  different  spatio-temporal  scales  give  rise  to 
objects  in  the  data. 

Ex:  objects  include  sample  points,  trajectories,  and  bundles  of 
trajectories. 

•  Objects  have  different  relationships,  e.g.  adjacency  and 
structure/substructure. 

Ex:  objects  have  geometric  nearness/adjacency  relationships; 
points  comprise  trajectories  which  comprise  bundles. 

•  Objects  interact  and  evolve. 
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SAL  Programming  Style 


3.  Identify  layers  of  abstraction. 

•  Build  a  hierarchy  relating  objects  of  different  granularities. 
Ex:  points  — ►  trajectories  — *•  bundles. 

•  Describe  abstraction  transformations  and  pre-/postconditions 
for  application. 

Ex:  abstract  linearly-connected  points  into  curves  and 
“similarly-shaped”  adjacent  curves  into  bundles. 
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SAL  Programming  Style 

4.  Flesh  out  internals  of  each  abstraction  layer. 

•  Guided  by  layers  of  abstraction:  connect  output  of  previous 
layer  to  input  of  next  layer. 

•  Build  a  neighborhood  graph  explicating  an  adjacency  relation 
based  on  domain  knowledge  and  structure  of  output. 

Ex:  relate  points  with  MST  (close  to  linearly-connected);  relate 
trajectories  based  on  connected  substructure. 

•  Filter  the  neighborhood  graph  based  on  predicates  from 
domain  knowledge  and  abstraction  preconditions. 

Ex:  eliminate  long  edges  in  MST;  test  curve  similarity. 
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Tutorial  Roadmap 

•  Introduction  and  Motivation 

•  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

•  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIPAIR,  Fluids 

•  Cognitive  Foundation  and  Related  Work 

•  Spatial  Aggregation  Language  (SAL) 

>  SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
maglev  control  experiment,  diffusion-reaction  morphogenesis 

•  References 
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SA  Applications  Roadmap 

Distributed  optimization  and  control  (C.  Bailey-Kellogg) 
Weather  data  analysis  (X.  Huang) 

Maglev  control  experiment  (J.  May  and  S.  Loh) 

Qualitative  analysis  of  diffusion-reaction  systems  (I.  Ordonez) 
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Thermal  Material  Processing 


C.  Doumanidis,  IEEE  Control  Systems,  August  1997 

•  Task:  rapid  prototyping  for  thermal  fabrication  (welding). 

•  Set-up: 

—  Plasma- arc  heat  source;  tungsten  torch 
—  High-speed  servodriven  X-Y  positioning  table 
-  256x200  (0.12mm  resolution)  infrared  camera 

•  Approach:  feedback  control  on  linearized  model;  parameters 
identified  at  run-time. 


V 
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Rapid  Thermal  Processing 

T.  Kailath  et  al,  in  The  Control  Handbook ,  1996 

•  Task:  to  maintain  a  uniform  temperature  distribution  to  ensure 
high  yield  for  semiconductor  curing. 

•  Set-up:  Concentric  rings  of  lamps;  separate  power  control  for 
each  zone. 

•  Approach:  feedforward  control  with  feedback  tuning  on 
linearized  model. 
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Our  Motivating  Example:  “Local  Warming” 


•  Design  task:  determine  the  placement  and  actions  of  controls 
to  achieve  a  desired  temperature  profile. 

•  Input:  geometry,  boundary  conditions,  material  properties, 
design  constraints 

•  Output:  number,  locations,  and  control  actions  for  heat 
sources 


Page  MP2-152 


AAAI9S  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Approach 

Model  domain  knowledge  in  SA  framework. 

Find  structures  in  temperature  data. 

Exploit  structures  to  determine  control  locations. 
Exploit  structures  to  determine  control  parameters. 
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Mathematical  Models  for  Heat 


Steady-state:  asymptotic  temperature  distribution 

-  kV2<p  +  Q  =  0 

*  V2  is  the  Laplace  operator. 

*  <f>  is  the  temperature  field. 

*  k  represents  the  material  properties. 

*  Q  is  the  contribution  from  heat  sources. 

-  Temperature  and  heat  source  contribution  are  functions  of 
spatial  variables. 

Transient:  temperature  profile  over  time 

-  dep/dt  =  kV20  +  Q 

-  Temperature  and  heat  source  contribution  are  functions  of 
spatial  variables  and  time. 
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SA  Model  for  Temperature  Computation 


•  Field:  {  (point,  temperature)  } 

For  transient,  also  discretize  in  time. 

•  Neighborhood  graph:  finite  difference  grid  or  finite  element  mesh 


•  Object  interaction  rules :  propagation  based  on  heat  equation, 
with  heat  source  contributions  at  discrete  locations/ times. 
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SA  vs.  Traditional  Engineering  Methods 


SA  provides  a  qualitative  reasoning  approach  to  programming  with 
physical  fields: 

•  The  structure  of  a  field  discretization  is  explicitly  represented. 

•  Behaviors  are  inferred  using  a  small  number  of  operations  on 
the  field  structure,  so  that  results  can  be  explained  in  terms  of 
local  object  interaction  and  evolution. 

•  Objects  in  a  field  can  be  manipulated  at  multiple,  non-uniform 
layers  of  abstraction. 

As  a  result,  SA  supports  a  variety  of  inference,  explanation, 
tutoring,  and  design  tasks. 

_ _ _ y 
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Structures  in  Temperature  Data 

Control  design  will  utilize  structures  uncovered  in  temperature 
data: 

•  Rates  of  decay  in  different  directions  indicate  rates  of  heat  flow. 

•  Effects  of  controls  are  predominantly  local. 

•  Effects  of  controls  can  be  linearly  superposed. 
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Structures  in  Temperature  Data:  Isotherms 


Use  SA  classify  operator  to  find  equivalence  classes  of  similar 
temperature  values  in  neighborhood  structure. 
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Related  Work:  Qualitative  Physical  Fields 

Lundell  ( AAAI-96 )  provides  a  qualitative  model  for  processes  such 
as  diffusion. 

•  Represent  topology  of  qualitatively-similar  regions  in  fields. 


WH hot  Swarm  Scool 


Intersect  fields  (e.g.  temperature  field  and  shade  field). 

Model  spatio-temporal  evolution  of  fields  with  region 
interactions. 
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Structures  in  Temperature  Data: 
Gradient  Vector  Directions 

Use  SA  field  operations  to  calculate  gradient  vectors.  Direction 
points  downhill;  magnitude  represents  rate  of  change. 
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(Lengths  normalized  for  visibility.) 
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Structures  in  Temperature  Data: 
Gradient  Trajectories 


Use  SA  classify  operator  to  group  gradient  vectors  into  trajectory 
curves  based  on  similarity  in  direction. 


Curves  are  downhill  paths  through  the  temperature  landscape;  rate 


of  descent  indicates  rate  of  heat  flow. 
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Steady-state  Transient 


•  Predominantly  local  effects  for  controls. 

•  Different  hill  shapes  at  different  points. 

•  Different  hill  slopes  in  different  directions. 
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Thermal  Hill  Linearity 

Scalability:  Scaled  thermal  hill  is  equivalent  to  thermal  hill 
with  source  value  scaled. 


(source  =  1)  (source  =  10) 

Superposability:  Sum  of  thermal  hills  is  equivalent  to 
thermal  hill  with  both  sources  active. 


(source  1  on)  (source  2  on)  (both  sources  on) 
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Influence  Graph 


Abstract  thermal  hill  for  field  nodes  F  and  control  nodes  C: 

•  Vertices  V  =  C  U  F. 

•  Edges  E  =  C  x  F. 

•  Edge  weights  w  :  E  — ■*  1Z  such  that  w((c,f ))  is  the  field  value 
at  /  given  a  unit  control  value  at  c. 

•  A  thermal  hill  is  a  pictorial  representation  of  an  influence 
graph  from  one  control  node. 
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Field  Nonlinearities 


•  Material  properties  can  vary  nonlinearly  with  position. 

•  The  temperature  is  still  linearly  dependent  on  control  values. 

•  Discretization  of  heat  equation  yields  linear  equations  relating 
temperature  and  heat  source  input  at  a  node  with 
temperatures  at  neighboring  nodes. 

•  An  influence  graph  exposes  linear  dependence  on  control 
values,  encapsulating  the  nonlinearities  in  field. 


•  Edge  weights  measured  for  a  physical  system  represent  a  form 
of  system  identification,  where  exact  material  properties  are 
unknown. 
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Viewpoints  on  Influence  Graph 


•  Physicist:  discretized  Green’s  function. 

•  Engineer:  distributed  impulse  response,  transfer  function. 

•  Mathematician:  (decentralized  form  of)  the  inverse  of  the 
capacitance  matrix  modeling  heat  diffusion. 
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Summary  of  Structures  in  Temperature  Data 

*  Aggregated  gradient  vector  trajectories  represent 
directions/rates  of  heat  flow. 

•  Influence  graph  encapsulates  locality  and  linear  superposability 
of  control  effects,  hides  nonlinearities  in  field. 
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Structure  Design 


Goal:  determine  number  and  positions  of  controls. 

Approach:  decompose  the  problem  so  as  to  minimize  the 
coupling  between  subparts. 
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Decomposition  Algorithm 


Temp  Temp  [  Temp  |  |  Temp  |  |  Temp  |  •  ' 


subtract 


classify 
on  direction 


Trajectory  | 


Trajectoryl 


compare  average 
gradient  magnitude 

partition  along  direction 


Weak  coupling  direction) 


Control  location 
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Decomposition  Example:  Isotherms 


A  single  heat  source  placed  near  the  center  of  mass  does  not 
adequately  control  the  entire  sheet.  However,  as  with 
dumbbell- shaped  material,  isotherm  separations  indicate  amount  of 
coupling. 
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Decomposition  Example:  Gradient  Trajectories 


Examine  gradient  magnitudes  along  trajectories  to  find  weak 
directions.  Partition  field  along  weak  trajectories. 
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Decomposition  Example:  Partition 


This  partition  corresponds  to  our  geometric  intuition;  the  method 
works  even  for  varying  material  properties,  where  geometry  isn’t 
enough. 
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Structure  Design  Summary 

•  Structures  in  data  (gradient  magnitudes  along  trajectories) 
indicate  weak  coupling  directions. 

•  Principled  method  to  decompose  problem:  partition  so  that 
sub-problems  are  weakly  coupled. 
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SA  Decomposition  vs.  Domain  Decomposition 

•  Domain  decomposition  algorithms  solve  partial  differential 
equations  by  dividing  a  field  into  subregions  and  (iteratively) 
combining  the  solutions  for  the  subregions. 

•  SA  decomposition  exploits  the  same  kind  of  physical  knowledge 
to  partition  a  field. 

•  SA  decomposition  is  performed  in  terms  of  structures  in  data 
(gradient  trajectories). 

•  SA  can  explain  design  decisions  in  terms  of  these  structures 
and  the  physical  knowledge  they  represent. 
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Decentralized  Parameter  Optimization 


•  Goal:  determine  control  values. 

•  Approach:  SA  local  interaction  rules  between  control  nodes 
and  field  nodes. 

•  Algorithm: 

Repeat:  independently  adjust  each  control  value  so  as  to 
reduce  error  in  temperature  profile. 
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Improving  Decentralized  Parameter  Optimization 

Leverage  structural  knowledge  (locality,  linearity  in  control): 

1.  Evaluate  temperature  field  efficiently. 

2.  Reduce  communication. 


3.  Jointly  optimize  where  appropriate. 
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Influence- Based  Field  Evaluation 


At  each  optimization  step,  evaluate  control’s  effect  on  temperature. 

•  Standard  approach:  iteratively  solve  heat  equation. 

•  Fast  approach:  exploit  linear  superposability. 

For  modified  control  value,  subtract  old  scaled  influence,  add 
new  scaled  influence: 


Subtract  old  Add  new 
(Equivalently,  add  influence  scaled  by  control  value  difference.) 
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Influence-Based  Field  Evaluation  Algorithm 
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Influence-Based  Field  Evaluation 
Performance  Data 


•  P  shape  (1103  nodes);  4  controls 

•  C++-based  SA  library  on  a  100MHz  Pentium  /  Linux  /  gcc 

•  49  seconds  to  solve  iteratively 

•  0.02  seconds  to  solve  with  influence  graph  mechanism. 

•  Savings  at  each  step  of  optimization! 

(Most  tests  took  20-100  iterations.) 
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Reduced  Communication 


At  each  step,  estimate  error  due  to  control  adjustment. 

•  Slow  but  accurate:  check  all  field  nodes. 

•  Faster  but  less  accurate:  check  more  strongly-influenced  nodes 
more  often: 

/\-Very  often 

.Not  so  often 


Trade  control  accuracy  for  communication. 
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'  Reduced  Communication  Performance  Tests 

Optimizers: 

•  Matlab-based  (centralized)  optimizers:  Gauss-Newton  and 
Broyden-Fletcher-Golfarb-Shanno 

•  SA-based  (decentralized)  optimizers:  SA1-SA4.  communication 
proportional  to  influence  (different  proportionality  constants) 

Problems  (20x20  grid): 

•  4  heat  sources  near  corners 

•  4  heat  sources  near  center 

•  16  heat  sources  tiled  over  domain 
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Reduced  Communication  Performance  Data 

•  Number  of  iterations  to  converge  to  solution. 

•  Total  control-field  communications  during  optimization. 

•  Error  when  converged. 
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Reduced  Communication  Performance  Data 


Note  long  flat  region  where  communication  is  reduced  without 
'^significantly  impacting  error. _ _ _ 
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Joint  Optimization 


Controls  may  be  more  or  less  independent. 

•  Coupling: 

•  Actions  of  one  affect  potential  actions  of  other. 


•  Might  require  more  iterations  to  converge. 


•  Might  converge  to  sub-optimal  solution:  independently 
adjusting  either  control  value  increases  error,  but  increasing 
one  and  decreasing  the  other  decreases  error. 


Page  MP2-188 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


AAAI98  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Page  MP2-190 


AAAI9S  Tutorial 


Intelligent  Simulation 


Zhao/Bailey-Kellogg 


Joint  Optimization  Performance  Tests 

SA-coop  optimizer:  supervisors  between  neighboring  control  pairs 
Problems: 

•  4  heat  sources  packed  near  edge  of  20x20  grid 

•  16  heat  sources  packed  near  center  of  20x20  grid 

•  15  time-step  heat  sources  of  5x5  grid 
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4-packed 


#  iter 
error 


16-packed 


#  iter 
error 


15- time 


#  iter 
error 


BFGS 

SA 

SA-coop 

96 

78 

28 

.6725 

.6737 

.6725 

207 

167 

70 

.3357 

.3371 

.3357 

226 

64 

25 

.1190 

.1189 

.1189 
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Parametric  Design  Summary 

Structures  in  data  (influence  hills)  expose  locality,  linearity  in 
control. 

Principled  method  to  trade  off  computation,  communication, 
and  control  quality:  exploit  locality  and  linearity  of  control 
encapsulated  in  influence  graph. 
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Summary 

Use  SA  structure-based  design  for  control  of  heat. 


•  Distributed  (“local  warming”)  framework. 

•  Explicitly  use  physical  knowledge  (weak  coupling  directions, 
locality,  linearity  in  control). 

•  Structures  make  explicit  wrhere  trade-offs  can  be  made. 

•  Structures  are  useful  for  explanation. 
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SA  Applications  Roadmap 

•  Distributed  optimization  and  control  (C.  Bailey- Kellogg) 

>  Weather  data  analysis  (X.  Huang) 

•  Maglev  control  experiment  (J.  May  and  S.  Loh) 

•  Qualitative  analysis  of  diffusion-reaction  systems  (I.  Ordonez) 
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Multi-Level  Structures  in  Weather  Data 


Sample  points,  isobar  curves,  pressure  cells 
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Weather  Map  Analysis 

Air  Weather  Service,  Back  to  Basics ,  in  AWS  FOT  Seminar 
STT-Q9-0004 ,  1975. 

•  “At  850mb,  the  polar  front  is  located  parallel  to  and  on  the 
warm  side  of  the  thermal  packing.” 

•  “Identify  700mb  trough  and  ridge  positions  to  establish  vertical 
consistency  (stacking)  with  surface  and  850mb  features.” 

•  “Major  and  minor  500mb  troughs  are  good  indicators  of 
existing  or  potential  adverse  weather.” 

•  “Lows  tend  to  stack  toward  colder  air  aloft  while  highs  tend  to 
stack  toward  warmer  air  aloft.” 
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Key  Observation  in  Weather  Analysis 


•  Think  of  weather  features  as  geometric  objects  with  spatial 
distribution  and  movement. 

•  Identify  properties  of  these  objects  (shape,  size,  density). 

•  Rules  of  thumb  correlate  different  weather  features  and 
establish  prediction  patterns. 
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Weather  Interpretation  Tasks 


Identify  and  describe  features  in  weather  data: 

•  Find  pressure  cells,  troughs,  ridges,  fronts, - 

•  Extract  geometric  properties:  location,  shape,  size, 

•  Describe  features  at  multiple  layers  of  granularity. 


Task  characteristics: 


The  problem  is  ill-defined  and  difficult  to  quantify. 

Massive  amounts  of  spatially-distributed  data  —  efficient 
algorithms  required. 
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Our  Motivating  Example: 
Pressure  Cell  Identification 


•  Task:  given  pressure  data,  find  low/high  pressure  cells. 

•  SA-based  approach 

1.  Build  local  topology  for  isobars. 

2.  Extract  appropriate  extremal  isobars. 

•  Unlike  numerical  thresholding  techniques,  the  same  SA 
approach  applies  to  other  structure  finding  problems  in 
weather  data  (locating  trough/ridges,  fronts) 
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Isobar  Topology  Construction 


Key  insight:  distinguish  two  types  of  spatial  adjacency  on  input 
data. 
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Strong  Adjacency 

A  strong  adjacency  bonds  lower-level  objects  into  higher-level 
objects. 


• . * 
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Weak  Adjacency 


Use  remaining  weak  adjacencies  to  form  topology  on  higher-level 
objects. 
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Extended  Example:  Pressure  Data  Points  ' 
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Summary 

A  computational  mechanism  for  identifying  and  extracting  implicit 
structures  in  spatial  data: 

•  Identify  strong  and  weak  adjacency  relations  among  spatial 
objects. 

•  Aggregate  strong  adjacencies  to  construct  higher-level  objects; 
aggregate  weak  adjacencies  to  relate  higher-level  objects. 

•  Organize  spatial  information  in  a  structured  model  for  further 
processing. 

•  The  mechanism  has  been  shown  useful  in  labeling  high/low 
pressure  cells. 
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SA  Applications  Roadmap 

•  Distributed  optimization  and  control  (C.  Bailey-Kellogg) 

•  Weather  data  analysis  (X.  Huang) 

>  Maglev  control  experiment  (J.  May  and  S.  Loh) 

•  Qualitative  analysis  of  diffusion-reaction  systems  (I.  Ordonez) 
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Problem  Statement 

Focus  on  the  stabilization  problem: 


•  Given:  a  physical  system  and  a  goal  state  (or  set  of  goal  states) 

•  Objective:  derive  a  control  law  to  drive  the  system  into  one  of 
the  goal  states 
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Goals 


•  To  supplement  standard  linear  techniques  when  such 
techniques  are  inadequate. 

•  To  replace  the  analytical  analysis  of  current  nonlinear 
techniques  with  computational  exploration. 

•  To  improve  control  by  exploiting  geometric  features  of  phase 
space. 

•  To  make  explicit  the  tradeoffs  between  various  control  criteria. 
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Example:  Behavioral  Boundaries 


A  “behavioral  boundary”  in  phase  space  is  an  area  of  phase  space 
where  the  field  direction  in  neighboring  cells  differs  substantially. 
Goal 


"Bad  region" 
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Geometric  Interpretation  of  Performance 


•  Controllability:  the  set  of  reachable  states  forms  a  region  in 
phase  space 

•  Stability:  set  of  initial  states  that  evolve  to  same  limit  set 


•  Robustness:  certain  types  of  uncertainties  can  be  modeled  as 
regions 

•  Optimality:  considerations  on  resource  consumption 
parameterize  phase-space  trajectories 
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The  Maglev  Experiment 

Highly  nonlinear  system 

Has  practical  applications  in  magnetically  levitated 
transportation  systems  (i.e.  EMS  systems) 


Photo  sensors 


Model: 


x  =  v 
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Data  Flow  in  Synthesizing  Phase-Space  Control 

Laws 
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Instantiation  of  SA  Framework 


•  Phase  and  control  space  discretized  uniformly. 

•  Behavioral  boundary  is  used  at  first  level  classification. 

•  Adjacencies  at  2nd  level  are  determined  using  4th-order 
Runge-Kutta  integrator. 

•  Edges  at  the  2nd  level  are  weighted  by  the  distance  to  the 
nearest  behavioral  boundary. 

•  The  graph  is  searched  for  minimal  distance  paths  using  an 
iterative  method. 
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Related  Work 


•  Hsu:  Cell-based  mapping 

•  Bradley  and  Zhao:  Phase-space  control  synthesis  algorithms 

•  Caines  and  Wei:  Dynamically  consistent  hybrid  systems 

•  Control  of  chaos 
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Summary 

SA  provides  a  framework  for  exploiting  geometric  features  of 
the  phase  space. 


•  Phase-space  features  can  be  used  to  derive  useful  performance 
metrics. 

•  This  framework  has  been  successfully  applied  to  a  practical 
application  (maglev). 
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Open  Questions 


•  What  other  geometric  features  are  useful  for  control  and 
analysis? 

•  How  can  the  framework  be  efficiently  applied  to 
high-dimensional  systems? 


How  can  the  framework  be  expanded  to  handle  poorly-modeled 
systems  or  systems  that  change  over  time? 
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SA  Applications  Roadmap 

•  Distributed  optimization  and  control  (C.  Bailey- Kellogg) 

•  Weather  data  analysis  (X.  Huang) 

•  Maglev  control  experiment  (J.  May  and  S.  Loh) 

>  Qualitative  analysis  of  diffusion-reaction  systems  (I.  Ordonez) 
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Morphogenesis  and  the  Diffusion-Reaction  Model 

•  Morphogenesis:  how  do  organisms  grow  into  particular  shapes? 

•  Turing  model  for  pattern  development  in  space: 
diffusion-reaction 

—  Represent  two  or  more  substances  that  diffuse  and  react 
with  each  other  in  space,  changing  their  concentrations 
during  the  process. 

—  When  diffusion  rates  are  different  and  reaction  processes  are 
appropriate,  the  concentration  of  substances  tends  to  form 
spatial  and  temporal  patterns  (Turing  patterns). 


V 
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Understanding  Turing  Patterns: 
Beyond  morphogenesis 


•  Diffusion-reaction  models  describe  numerous  natural 
phenomena,  including  morphogenesis,  well-known  chemical 
processes,  population  dynamics,  and  formation  of  large 
structures  in  the  universe. 

•  Understanding  this  set  of  phenomena  is  important  in  a  variety 
of  scientific  endeavors. 


•  Although  mathematically  simple,  Turing  patterns  have  been 
studied  analytically  with  very  limited  success.  Numerical 
simulation  is  often  used  to  elaborate  the  model  behaviors. 


Our  goal  is  to  attain  a  systematic  qualitative  description  and 
classification  of  these  phenomena  through  computational 
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Models  of  Diffusion:  The  heat  equation 

Diffusion  is  governed  by  the  heat  equation: 


du 

dt 


=  DuV2u 


•  V2:  the  Laplace  operator 

•  u:  a  scalar  field  representing  intensity  or  concentration 

•  Du'-  diffusion  rate 


Irregularities  in  the  field  intensity  tend  to  even  out,  and  the 
substance  spreads  through  space. 


(1) 
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Diffusion-Reaction  with  Two  Substances: 
A  generic  model  of  pattern  formation 


Two  heat  equations  are  coupled  by  reaction  components: 

i 

—  =  D„V2u  +  /„(u,  v) 

—  =  DvV2v  +  fv{u,v) 


Typically,  the  substance  that  diffuses  faster  is  continuously  fed  into 
the  system,  and  is  consumed  by  the  reaction,  a  process  that 
produces  the  other  substance. 
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The  Gray-Scott  Model:  A  model  of  glycolysis 

The  Gray-Scott  model  for  a  real  chemical  process: 

•  Two  substances,  U  and  V,  with  the  transformations: 


—  U  +  2V  — ►  3V :  U  is  transformed  into  V. 

—  V  —>  P:  V  is  lost  by  transformation  into  an  inert 
compound,  at  a  rate  K. 

-  U  is  constantly  fed  into  the  system,  both  U  and  V  are 
removed  from  the  system  by  the  feed  process. 

-  U  diffuses  faster  than  V. 


The  model: 


du 

dt 

dv 

dt 


=  DuV2u  —  uv 2  +  F(  1  —  u ) 
=  DvV2v  +  uv 2  —  (F  +  k)  v 
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Simulation  of  Gray-Scott  Model  in  2D: 

Complex  behaviors  from  simple  model 

•  Gray-Scott  model  exhibits  a  wide  variety  of  behaviors, 
depending  on  the  choice  of  its  two  parameters. 

•  These  behaviors  have  been  observed  both  in  chemical 
experiments  and  numerical  simulations,  and  they  range  from 
stable  hexagonal  arrays  to  chaotic  motion  of  unstable  shapes. 


V _ > 
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Qualitative  Analysis  and  Spatial  Aggregation: 
Identify  and  extract  coherent  objects  in  fields 

•  Represent  the  implicit  structure. 

•  Form  a  theory  of  object  interaction  and  evolution. 

•  Explicate  cause-effect  relationships  among  objects. 

•  Spatial  Aggregation  is  well  suited  for  finding  structural 
organization  in  fields. 
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Aggregation  through  Sampling: 

The  embedded  field  heuristic 

Embed  the  field  with  sampling  particles  (floaters): 

Particles  “float”  in  the  field,  repelling  each  other  to  minimize 
an  energy  measure,  multiplicating  in  regions  of  low  density  and 
perishing  whenever  their  density  is  too  high. 

Spatial  aggregation  aggregates  floaters  to  form  a  structural 
description  of  the  underlying  field 

Floaters  tend  to  persist  in  time,  except  at  bifurcations 
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Example:  An  N-Graph  on  a  sampled  field 


^  *y*  ; 


>*■ '  v*  . 

v* 


y 


*  —  'U 


Floaters  form  groups  that  tend  to  mirror  structures  in  the  field 

Aggregation  of  floaters  produces  discrete  polygons  that 
approximate  coherent  objects 

Floaters  vary  their  positions  as  the  field  changes 

Floater  persistence  simplifies  structural  correspondence  over 
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Summary 

Studied  a  particular  Diffusion-Reaction  model 

Developed  the  “embedded  field”  method  to  sample  and  register 
implicit  structures  in  a  continuous  field  in  concisely 

Persistence  of  sampling  floaters  simplifies  structural 
correspondence  over  time 
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Tutorial  Roadmap 

Introduction  and  Motivation 


•  Overview  of  Spatial  Aggregation  (SA): 

Imagistic  reasoning,  theory,  ontology,  language 

•  Examples  of  Spatial  Aggregation: 

KAM,  MAPS,  HIPAIR,  Fluids 

•  Cognitive  Foundation  and  Related  Work 

•  Spatial  Aggregation  Language  (SAL) 

•  SA  Applications: 

Distributed  optimization  and  control,  weather  data  analysis, 
maglev  control  experiment,  diffusion-reaction  morphogenesis 


References 
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References  for  Further  Readings 
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Spatial  Aggregation  and  imagistic  reasoning: 
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experimentation  by  computer.  MIT  Press,  1991. 
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MAPS  and  automated  phase-space  analysis: 
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